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SUMMARY 


Objective 

The  purpose  of  this  research  was  to  develop  a  systematic  method  for  establishing  Air  Force 
officer  grade  requirements  based  on  job  content  and  responsibility.  Towards  this  objective,  two 
major  aspects  of  the  study  were  undertaken:  (a)  the  development  and  large-scale  field-testing  of  a 
reliable  and  systematic  method  by  which  Air  Force  Management  Engineering  Teams  (METs)  could 
determine  the  appropriate  grade  levels  (lieutenant  to  colonel)  of  non-aircrew  officer  positions  and 
(b)  the  application  of  this  technology  to  an  officer  job  sample  of  sufficient  size  to  estimate  the  grade 
requirements  for  the  total  non-aircrew  officer  force  and  various  officer  utilization  fields. 


Background 

The  basic  technology  used  in  this  study  has  been  under  development  and  refinement  during 
various  periods  over  the  past  15  years  and  represents  one  of  the  most  comprehensive  job  evaluation 
systems  in  existence.  The  large-scale  field  test  and  projections  in  the  present  effort  represent 
modifications  and  extensions  of  previous  research  studies. 


Approach 

To  test  the  technology  and  make  projections  of  non-aircrew  grade  requirements.  *)50  raters 
from  122  Air  Force-wide  MF!Ts  collected  and  evaluated  over  1 1.000  officer  job  descriptions  under 
detailed  instructions  which  assured  the  scientific  and  technical  integrity  of  the  data.  In  addition, 
ratings  were  obtained  from  these  METs  on  a  sample  of  jobs  (1.725)  which  had  previously  been 
evaluated  by  a  HQ  USAF’  Policy  Board.  Various  analyses  were  conducted  to  determine  the 
reliability  and  accuracy  of  the  MET  application,  and  the  stability  of  the  data  on  the  1 1 .000  jobs  for 
making  projections  to  the  total  non-aircrew  force.  An  integral  part  of  these  analyses  was  the 
development  of  a  policy  equation  and  grade  conversion  table. 


Specifics 

The  method  developed  to  establish  officer  grade  requirements  (OGR)  is  similar  to  a  yardstick, 
except  instead  of  measuring  feet  or  inches  it  measures  the  amount  of  job  content  and  responsibility 
associated  with  officer  positions.  As  the  level  of  content  and  responsibility  level  of  jobs  change,  so 
does  the  appropriate  grade  level  for  those  jobs.  The  basic  ingredient  of  this  yardstick  is  an  eight- 
variable  equation  applied  to  data  collected  by  manpower  and  management  engineering  personnel. 
The  first  essential  component  involved  in  the  application  was  a  job  description  completed  by  officers 
using  a  standard  form  that  provided  a  listing  of  duties  and  tasks  performed  and  organizational 
information  regarding  the  position.  The  descriptions  were  then  evaluated  by  the  officer's  supervisor. 
Next.  M  ET  members  evaluated  each  officer  job  description,  and  rated  these  descriptions  in  terms  of 
five  job  factor  benchmark  scales.  In  brief,  the  eight-variable  equation  consisted  of  the  five  job 
evaluation  factors  (benchmark  scales),  two  organization  information  variables,  and  the  supervisor's 
judgment  of  the  appropriate  grade  for  the  job. 

Analyses  revealed  that  MET  raters  could  very  accurately  and  efficiently  apply  the  (Hill 
technology.  For  a  subsample  (1.725)  of  officer  positions,  using  MET  ratings  in  the  eight-variable 
policy  equation,  it  was  possible  to  estimate  with  considerable  assurance  the  results  that  would  be 


I 
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obtained  if  METs  were  to  apply  the  OCR  technology  to  all  Air  Force  non-aircrew  officer  positions 
(62.602).  The  sampling  base  (over  1 1.000  jobs)  was  sufficient  to  provide  projections  for  the  total 
non-aircrew  force  and  54  officer  utilization  fields. 

Comparison  of  projected  grade  requirements  with  currently  authorized  unit  detail  listing 
(II DL)  grade  levels  revealed  that  the  total  non-aircrew  force  has  fewer  authorized  field-grade  officer 
positions  than  are  indicated  by  the  OCR  technology.  While  the  results  indicated  there  were  more 
U l)L  colonel  authorizations  than  estimated  by  OCR.  there  was  an  increase  in  the  OC R  estimates  for 
lieutenant  colonels.  The  lieutenant  colonel  increase  more  than  balanced  the  colonel  reductions. 
Further,  the  DDL  versus  OCR  difference  was  particularly  striking  at  the  major  grade  level  where 
OCR  recommended  a  very  substantial  increase  in  grade  requirements.  At  the  combined  captain/ 
lieutenant  grade  level,  OCR  reflected  a  large  reduction  in  grade  requirements  as  compared  to  I '  1)1. 
authorizations. 

The  preceding  problem  (i.e..  increase  in  majors  and  decrease  in  eaptainsAieutenants)  should  he 
considered  from  the  viewpoint  that  the  Air  Force  grade  structure  is  essentially  a  closed  system.  W  it h 
few  exceptions  (e.g..  physicians),  the  Air  Force  does  not  hire  captains  directly  from  the  civilian 
sector.  For  this  reason,  it  may  be  necessary  to  identify  a  certain  proportion  of  the  lower-level  OCR 
captain  positions  and  declare  them  to  be  lieutenant  positions  on  the  DDL.  Similarly,  it  may  be 
necessary  to  declare  a  small  proportion  of  the  lower-level  OCR  major  positions  to  be  captain 
positions  on  the  l’ 1)1,.  Such  actions  essentially  reflect  the  recognition  of  a  need  to  link  career 
progression  programs  with  job  requirements  in  order  to  provide  a  reasonable  officer  grade  structure. 

In  addition  to  comparisons  at  the  aggregated  force  level,  comparisons  of  DDL  versus  OCR 
stated  requirements  indicated  that  implementation  of  the  OCR  technology  would  produce 
significant  changes  in  stated  grade  requirements  for  many  specific  officer  utilization  fields.  In  some 
instances  there  was  a  general  downgrading  of  jobs  in  certain  utilization  fields;  in  others,  there  was 
general  upgrading  of  jobs.  These  findings  suggest  that  the  OCR  technology  should  be  particularly 
useful  with  regard  to  actions  taken  by  Air  Force  management  to  make  grade  adjustments  within 
officer  utilization  fields. 


Cone  lusions 

In  summary .  the  OCR  research  (a)  provided  a  scientific  technique  for  determining  officer  grade 
requirements  based  upon  job  content  and  responsibilitv  levels,  (h)  demonstrated  that  M  F.Ts  are  able 
to  accurately  and  consistently  apply  the  technology;  (c)  indicated  a  need  for  an  increase  in  the  stated 
requirements  for  non-aircrew  field  grade  positions:  and  (d)  suggested  significant  changes  in  the  grade 
requirements. structures  for  mam  officer  utilization  fields.  If  \ir  Force  management  decides  to 
implement  a  system  for  determining  grade  requirements  based  on  job  content  and  responsibility  .  the 
(Mill  technology  is  recommended  for  consideration,  in  conjunction  with  other  manpower  and 
ill  a  nagem  en  t  proced  ii  res. 


PREFACE 


This  report  presents  results  of  a  study  conducted  under  AFHRL  work  unit  77340208,  Determination 
of  Non-Aircrew  Officer  Grade  Requirements:  Conversion  Table  and  Projections  by  METs.  This  work  unit 
was  established  in  response  to  Request  for  Personnel  Research  (RPR  75-21).  Determination  of  Officer 
Grade  Requirements  Based  on  Job  Content  and  Responsibility,  initially  submitted  by  HQ  USAF/PRM  and 
DPXX  (The  Air  Force  Management  Engineering  Agency  subsequently  assumed  responsibility  as 
requirements  manager  for  AF/PRMRE).  The  research  is  a  follow-on  effort  to  RPR  74-20,  titled 
"Development  and  Testing  of  an  Officer  Grade  Evaluation  Technology.”  The  report  describes  the 
continuity  between  the  initial  Officer  Grade  Requirements  (OGR)  project  and  research  results  stemming 
from  RPR  74-20  and  RPR  75-21.  with  emphasis  on  the  latter  request. 

This  study  does  not  constitute  authority  to  change  existing  Air  Force  officer  grades,  and  its 
publication  does  not  infer  approval  to  implement  report  procedures  as  USAF  policy.  Such  actions  or 
objectives  are  a  function  of  HQ  liSAF.  Further,  the  report  does  not  attempt  to  tie  into  or  address 
provisions  of  the  Defense  Officer  Personnel  Management  Act  (DOPMA).  nor  does  it  claim 
compatibility  with  same.  While  the  report  does  briefly  mention  grade  authorizations  and  career 
planning  objectives,  it  neither  fully  addresses  or  encompasses  the  entire  problem  of  grade 
distributions  to  support  orderly  career  progression  plans  nor  recognizes  external  limitations  on  Air 
Force  grade  structure.  Although  the  philosophy  and  methodology  of  the  report  are  assumed  to  be 
valid,  accurate  and  unbiased,  the  report  should  be  viewed  from  the  prospective  that  considerable 
efforts  over  the  years  have  allowed  USAF  to  determine,  establish,  and  defend  Air  Force  grade 
requirements,  albeit  multi-faceted  approaches  were  utilized. 

Due  to  the  scope  of  this  research  effort,  it  is  not  possible  to  mention  all  scientific,  military  and 
support  personnel  who  contributed  to  the  OGR  studies.  However,  accomplishment  of  the 
requirements  for  RPR  75-21  involved  the  following  individuals  (titles/organizations  as  of  April 
1978). 

AFMEA:  Capt  Robert  T.  Walker.  Air  Force  Management  Engineering  Agency.  AFMEA/ 

AFHRL  Liaison  Officer. 

AFHRL:  Lt  Col  William  H.  Pope.  Chief,  Occupation  and  Manpower  Research  Division. 

Dr.  Raymond  E.  Christal.  Technical  Director.  Occupation  and  Manpower  Research 
Division.  General  Director  of  OGR  research. 

Dr.  Joe  T.  Hazel.  Chief.  Career  Development  and  Job  Evaluation  Branch.  Project 
Monitor. 

Mr.  Kenneth  D.  Finstuen.  RPR  75-21  Principal  Investigator. 

Dr.  Gary  Matthews.  Task  Scientist  and  initial  Principal  Investigator. 
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Analyst  and  Computer  Specialist. 
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Mrs.  Mary  J.  Carreon.  Chief,  Data  Preparation  Section  (SMOK) 
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NON-AIRCREW  OFFICER  POSITIONS: 
DETERMINATION  OF  GRADE  REQUIREMENTS 


I.  INTRODUCTION 


The  purpose  of  this  research  teas  to  develop  a  systematic  and  reliable  method  for  establishing  Air 
Force  officer  grade  requirements  based  on  job  content  and  responsibility.  This  study  investigated  a  job 
evaluation  technology  developed  for  the  non-aircrew  officer  force,  which,  with  certain  operational 
adaptations,  could  be  applied  by  the  Air  Force  personnel  and  manpower  management  communities. 

The  present  study  consisted  of  two  major  research  objectives.  The  first  was  the  development  and 
large-scale  field-testing  of  a  reliable  and  systematic  method  by  which  Management  Engineering  Teams 
(METs)  could  determine  the  appropriate  grade  levels  of  non-aircrew  officer  positions  (excludes  line 
pilots,  navigators,  physicians,  and  dentists).  The  second  objective  was  to  apply  the  technology  to  an  officer 
job  sample  of  sufficient  size  to  estimate  the  grade  requirements  for  the  total  non-aircrew  officer  force  and 
various  officer  utilization  fields. 

The  basic  technology  used  in  the  study  has  been  under  development  and  refinement  at  various 
periods  for  over  15  years,  and  represents  one  of  the  most  comprehensive  and  carefully  researched  job 
evaluation  systems  in  existence.  The  large-scale  field  test  and  projections  for  the  present  effort  represent 
modification  and  extension  of  methods  developed  during  the  1963-1966  time  period,  with  an  application 
of  the  methodology  by  Management  Engineering  Teams  (METs)  during  1974.  Complete  documentation  of 
the  entire  stream  of  officer  job  evaluation  research  is  available  in  the  form  of  technical  reports  listed  in  the 
Reference  and  in  the  Bibliography  sections.  Key  references  in  this  series  are  the  following:  Brokaw  jnd 
Giorgia.  1966;  Christal.  1965,  1975:  Hazel.  1965;  Hazel.  Ghristal.  and  Hoggalt.  1966;  and  Stacy. 
Matthews,  and  Hazel.  1975.  A  companion  report  (Finstuen.  Matthews.  &  Pope,  1980)  to  the  present  study 
provides  supplemental  detailed  information  regarding  the  current  effort.  With  the  author's  permission, 
various  sections  from  two  reports  (Christal.  1965;  Christal.  1975)  were  paraphrased  extensively  (see 
Sections  III  &  VI)  to  provide  a  complete  account  of  the  research  program. 

The  majo'-  research  efforts  in  chronological  sequence  of  accomplishments  are  as  follows:  (a)  Officer 
Grade  Requirements  (OGR)  Project.  1963 — 1965.  (b)  Development  of  Benchmark  Scales.  1966.  (c)  Test 
Application  of  OGR  Technology  by  METs.  1974.  and  (d)  Field-Test  and  Projections  of  Non-Aircrew 
Officer  Grade  Requirements.  1976.  The  1976  effort  is  of  primarv  emphasis  in  this  report. 


II.  BAC.KtiROl  NO 


There  was  a  time  in  the  military  services  when  the  determination  of  grade  requirements  was  basically 
a  function  of  the  size  of  the  unit  commanded.  However,  technological  changes  have  created  many  new 
jobs  which  cannot  be  graded  on  such  a  basis,  so  the  rules  for  assigning  a  grade  level  to  a  particular  job  or 
position  have  become  less  clear. 


From  1  9(>:i  to  1965.  a  project  was  undertaken  to  determine  the  appropriate  distribution  of  Air 
Force  officer  grade  based  on  job  requirements.  This  Officer  Grade  Requirements  (OGR)  studv 
provided  a  set  of  job  evaluation  factors  for  defining  the  meaning  of  grade  and  a  basis  for  evaluating 
positions  in  terms  of  grade  requirements.  Subsequently  (I960),  a  factor  benchmark  scaling 
procedure  was  developed  for  application  to  individual  officer  positions.  Since  this  research  formed 
the  background  for  the  present  endeavor,  it  is  next  described  in  some  detail. 
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The  OGR  Project  was  conducted  in  three  phases.  F.ssentia)  steps  and  findings  for  each  of  these 
phases  were  as  follows. 


Phase  I:  Policy  Board  Grade  Ratings 
for  Jobs  in  Criterion  Sample 

Development  of  an  objective  and  systematic  method  for  grade  determination  required  an 
unbiased  and  stable  statement  of  appropriate  grades  for  a  sample  of  officer  jobs.  Grade  levels  assigned 
to  this  criterion  job  sample  by  a  HQ  I'SAF  Policy  Board  could  then  he  used  to  construct  a  grade 
"yardstick”  or  job  evaluation  system  (Phase  II).  which  in  turn  was  applied  to  the  remaining  Air 
Force  officer  jobs  (Phase  111).  Because  of  its  criticality  to  the  entire  project,  the  first  phase  merits 
particular  attention. 

Six  steps  were  involved  in  the  first  phase  of  the  OCR  project:  (a)  collection  of  descriptions  for 
approximately  80,000  officer  jobs,  (b)  selection  of  an  adequate  "criterion”  sample  of  descriptions 
representing  all  levels  and  types  of  Air  Force  officer  jobs,  (e)  selection  of  a  I’S  AF  Policy  Board,  (d) 
obtaining  grade  ratings  for  jobs  in  the  criterion  sample  from  Policy  Board  members,  (e)  analysis  of 
the  Policy  Board's  ratings  to  determine  that  they  were  reliable,  reasonable,  and  unbiased,  and  (f) 
acceptance  or  rejection  of  the  ratings  as  a  basis  for  establishing  Air  Force  policy  concerning  grade 
determination. 

The  first  major  step  of  the  project  was  to  collect  accurate  and  detailed  information  describing 
the  work  performed  by  Air  Force  officers  in  grades  lieutenant  through  colonel.  Forms  and 
instructions  were  developed,  and  job  descriptions  were  obtained  by  commands  from  all  officers 
except  generals,  student  officers,  patients,  air  attaches,  officers  in  the  medical-professional  and  dental 
utilization  fields,  and  selected  officers  in  the  operations  career  area.  Descriptions  w  ere  received  from 
79.750  officers. 

The  incumbents  were  asked  to  provide  a  job  title,  a  verbal  description  of  the  location  of  their 
particular  job  in  the  Air  Force  organizational  structure,  and  a  detailed  description  of  duties  and  tasks 
performed.  In  addition,  certain  background  and  assignment  information  was  obtained  (i.e..  duty 
A  FSC..  present  grade.  I  nit  M  anning  Document  (l  Ml))  grade  authorized,  organizational  level  of  job. 
and  level  of  job  within  the  organization).  The  incumbent’s  supervisor  was  then  asked  to  review  the 
completed  description  and  provide  a  judgment  concerning  the  appropriate  grade  level  for  the  job. 

For  the  second  step,  job  descriptions  were  sorted  into  l' Ml)  (subsequently  called  l  nit  Detail 
Fisting  (1  D I . ) )  authorized  gradc-hv-A  FSC.  categories,  and  a  representative  criterion  sample  of  .1.575 
cases  was  selected.  The  selection  procedures  offered  assurance  that  descriptions  respresenting  all 
levels  and  types  of  Air  Force  officer  jobs  were  included. 


() 


For  slop  throe,  a  Policy  Board  which  included  representatives  from  12  major  commands  was 
selected  by  HQ  l  S A  F .  The  board  was  composed  of  22  colonels,  selected  on  the  basis  of  their  overseas 
and  zone  of  interior  experience  in  particular  career  areas.  For  am  of  the  3.575  jobs  in  the  criterion 
sample,  there  was  at  least  one  member  who  could  serve  as  an  expert  consultant  to  the  rest  of  the 
board. 

To  obtain  grade  ratings  (step  four)  on  the  criterion  job  sample,  the  Policy  Board  was  convened 
by  HQ  l  SAF  for  5  days  during  February  ll)(>f.  During  this  period,  board  members  determined  the 
appropriate  grade  level  for  each  of  the  3.575  jobs.  Measures  taken  to  assure  that  ratings  were  reliable, 
valid,  and  unbiased  were  as  follows: 

1.  Board  members  were  instructed  by  the  HQ  l  SAF  Director  of  Manpower  and  Organization 
regarding  the  importance  of  their  mission,  to  be  as  impartial  and  objective  as  possible,  and  to  avoid 
any  tendency  to  exaggerate  grade  requirements. 

2.  Board  members  were  asked  first  to  rate  the  appropriate  grade  level  for  a  job  and  then  to 
indicate  on  a  3-point  scale  their  level  of  confidence  in  such  ratings.  They  were  given  access  to  any 
information  needed  to  make  accurate  judgments.  This  included  consultation  with  other  members: 
obtaining  organizational,  command,  or  installation  information  about  a  job:  and  calling  special  air 
staff  consultants  or  the  supervisor  of  the  incumbent  of  the  job  being  rated.  However,  members  were 
advised  that  their  ratings  were  to  be  independent  and  were  to  reflect  the  unbiased  judgment  of  the 
rater  alone.  The  board  members  were  not  allowed  to  have  knowledge  of  the  current  l  Ml)  grade 
authorized  for  the  job  being  rated  nor  of  the  grade  stated  by  the  incumbent's  supervisor.  They  were 
not  informed  of  the  grade  held  by  the  incumbent  in  the  job  nor  that  of  the  incumbent's  supervisor, 
nor  were  grade  ratings  assigned  by  other  board  members  available  to  the  rater. 

3.  Grade  ratings  for  each  job  were  obtained  independently  from  five  separate  board  members 
since  research  indicated  that  the  average  of  five  independent  ratings  provided  stable  estimates. 

t.  Each  job  was  rated  in  a  context  of  other  jobs  since  research  on  context  effects  indicated  that 
more  accurate  ratings  of  job  level  are  obtained  when  a  job  is  considered  w  ith  other  jobs  of  varying 
content  and  level. 

5.  Board  members  were  required  to  rale  grade  requirements  using  a  l(>-point  rating  scale  which 
recognized  three  levels  of  experience  requirements  within  each  grade  from  lieutenant  through 
colonel,  and  one  level  for  general  (Table  1).  This  scale  was  based  on  findings  that  ratings  are  more 
stable  when  judges  made  the  finest  discriminations  of  which  they  are  capable,  and  the  assumption 
that  experienced  officers  can  distinguish  jobs  requiring  high,  moderate,  or  low  levels  of  experience  or 
time  in  grade. 

Analysis  of  the  Policy  Board  rating  data  (step  5)  was  a  critical  part  of  the  OGR  project  since 
these  ratings  formed  the  basis  for  establishing  grade  requirements.  A  series  of  analyses  was 
accomplished  to  determine  if  the  grade  ratings  were  stable,  that  there  was  high  agreement  among 
board  members  concerning  the  appropriate  grade  requirements  for  particular  jobs,  that  the  raters 
had  confidence  in  their  ratings,  and  that  the  raters  were  not  biased  for  or  against  jobs  in  various  Vir 
Force  Specialty  ('.odes  (AFSCs)  or  commands.  The  principal  results  from  these  analyses  were  as 
follows: 

1 .  The  reliability  coefficient  (.‘12)  of  the  mean  grade  ratings  given  by  the  Policy  Board  indicated 
there  was  high  agreement  among  Board  members  concerning  grade  requirements  for  jobs  in  the 
criterion  sample.  A nother  statistic  (standard  error  of  estimate  =.?*>)  indicated  that,  if  judgments  of  a 
large  number  of  similar  boards  were  obtained.  *)5  percent  of  the  mean  grade  ratings  would  be  within 
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plus  or  minus  one-half  grade  level  of  the  mean  grade  ratings  eompuled  from  the  Policy  Hoard  data  (± 
1.55  on  the  !(>•  point  scale). 

2.  Based  on  a  8-point  rating  scale  (I  =  little  or  no  confidence.  2  =  some  confidence,  and  8  =  feel 
confident  rating  is  about  right).  Hoard  members  expressed  confidence  in  their  ratings  of  job  requirements. 
Kxauiination  of  the  mean  confidence  levels  expressed  by  members  in  their  ratings  of  if. 575  jobs  revealed 
that  for  2.587  of  the  jobs,  at  least  four  of  the  five  raters  expressed  the  highest  level  of  confidence  in  their 
judgments.  Only  50  of  the  8.575  jobs  had  a  mean  confidence  rating  of  less  than  2.00  on  the  8-poinl  scale. 

8.  Analyses  designed  to  identify  raters  showing  a  bias  for  or  against  jobs  in  various  command  or 
occupational  groupings  revealed  that  individual  Hoard  members  did  not  exhibit  a  bias  towards  jobs  in 
particular  commands  or  ,4FS(Cs.  For  15  command/ \FS(i  categories,  "bias"  values  were  computed  by 
taking  the  difference  between  the  average  of  ratings  assigned  by  a  rater  (on  the  l(>-point  scale)  to  jobs  in  a 
particular  category  from  an  average  of  ratings  assigned  by  ail  raters  to  jobs  in  that  category.  Since  three 
points  on  the  l(>-point  scale  represents  one  grade  level,  a  value  of  8.0  would  indicate  that  a  board  member 
rated  jobs  in  a  given  category  approximated  one  grade  higher  than  did  other  board  members.  Similarlv.  a 
value  of  -8.0  would  indicate  judgments  averaging  approximately  one  grade  lower  than  those  of  other 
members.  The  largest  reported  value  was  onlv  1.7.  and  most  of  the  values  were  less  than  1.0.  The  largest 
values  tended  to  he  associated  w  ith  judges  who  rated  all  categories  somewhat  high  or  low.  and  these  judges 
did  not  show  a  bias  toward  jobs  in  particular  categories. 

f.  Additional  analyses  indicated  that  Hoard  members  agreed  that  many  jobs  were  inappropriately 
graded  and  that  each  job  was  considered  on  its  own  merits.  (Comparison  of  I  MP  vs.  Policy  Hoard  grade 


K 


A Vi. 


revealed  no  systematic  tendency  on  the  part  of  raters  to  confirm  current  I  Ml)  grade  authorizations  or  to 
inflate  their  ratings  of  grade  requirements.  Many  jobs  were  downgraded  as  much  as  one  or  two  full  grade 
levels.  Others  were  upgraded.  Also,  the  reliability  analysis  indicated  there  was  strong  agreement  among 
board  members  as  to  which  particular  jobs  should  be  upgraded  or  downgraded. 

Step  6,  acceptance  or  rejection  of  the  Board  ratings  as  a  basis  for  establishing  Air  Force  policy 
concerning  grade  determination,  was  contingent  on  the  outcomes  from  the  preceding  steps.  As 
shown  in  the  findings,  the  Board  ratings  appeared  highly  defensible.  Since  these  ratings  were 
acceptable  as  standards  for  grade  determination,  the  second  phase  of  the  project  was  initiated. 

Phase  1L  Development  of  an  Officer  Grade 
Requirements  Policy  Equation 

The  second  phase  of  the  OCR  project  involved  the  development  of  a  mathematical  equation  to 
express  the  Policy  Board  in  terms  of  weighted  measures  of  job  characteristics.  To  be  acceptable,  it 
was  necessary  for  this  equation  to  assign  the  same  grade  to  a  job  as  the  Policy  Board.  Its  effectiveness 
was  gauged  by  the  extent  to  which  it  predicted  the  grades  assigned  by  the  board  to  the  3.575  jobs  in 
the  criterion  sample.  Four  steps  were  involved  in  this  phase  of  the  study:  (a)  hypothesizing  job 
requirement  factors  considered  by  Policy  Board  members  in  making  their  ratings;  (b)  evaluation  of 
the  criterion  jobs  in  terms  of  these  factors:  (c)  development  of  a  policy  equation  which  weights  the 
job  requirements  factors  into  a  composite  to  predict  the  criterion  board's  grade  ratings:  and  (d) 
evaluation  of  this  policy  equation. 

One  of  the  most  challenging  parts  of  the  OCR  study  was  the  identification  of  factors  considered 
by  the  Policy  Board  in  making  their  grade  ratings.  The  high  agreement  among  board  members 
concerning  appropriate  grade  requirements  for  jobs  in  the  criterion  sample  indicated  they 
considered  similar  factors  in  making  their  decisions.  The  four  classes  of  variables  hypothesized  and 
used  to  predict  Policy  Board  ratings  were  as  follows: 

Job  requirement  factors.  These  were  demands  on  the  job  which  were  considered  to  have  a 
bearing  on  grade  determination  (e.g.,  such  factors  as  the  complexity,  variety,  and  level  of  activities 
which  must  be  managed  by  the  job  incumbent;  the  possible  impart  of  decisions  made  by  the 
incumbent  on  Air  Force  mission:  the  types  of  planning  activity  required  of  the  incumbent:  and  the 
types  of  knowledges  and  experiences  the  incumbent  should  possess). 

0  rganizational  structure  factors.  It  was  hypothesized  that  the  location  of  the  job  in  the  A  ir 
Force  organizational  structure  would  have  a  bearing  on  grade  requirements. 

Coincidental  predictors.  It  was  hypothesized  that  certain  non-relevant  factors,  such  as  the 
number  of  words  in  the  job  description  or  the  verbal  facility  of  the  description  writer,  might  have 
influenced  judges  in  their  rating  of  a  job. 

Com  m  and  or  specialty  affiliation.  Data  concerning  some  of  the  factors  considered  were 
obtainable  from  job  descriptions  (e.g..  organizational  level  of  job).  However,  previous  research  and 
interviews  with  Policy  Board  members  suggested  certain  job  evaluation  factors,  such  as  planning  or 
type  of  judgments  required  by  the  job  incumbent  would  also  have  relevance  for  grade  determination. 
These  factors  could  be  measured  only  through  use  of  rating  scales,  and  a  procedure  had  to  be 
established  for  obtaining  such  ratings.  The  3.575  job  descriptions  were  sorted  into  143  booklets,  each 
containing  25  job  descriptions.  Each  booklet  was  sent  to  five  or  more  majors  or  lieutenant  colonels  in 
the  field,  who  were  selected  at  random  throughout  the  Air  Force.  Over  700  officers  participated  in 
this  phase  of  the  study.  Each  officer  rated  each  job  on  10  job  evaluation  factors  and  on  the  lh-point 


scale  which  was  used  by  (he  Policy  Board  in  making  their  grade  determinations.  Mean  rating  scores 
for  each  of  the  10  job  evaluation  factors  and  for  the  grade  rating  were  computed  for  each  job.  These 
scores  were  utilized,  along  with  other  variables,  in  deriving  the  final  policy  equation. 

In  the  development  of  an  equation  which  accurately  predicted  grade  ratings  made  by  the  Policy 
Board,  approximately  200  predictor  variables  and  350  regression  problems  were  considered.  The 
final  equation  contained  nine  predictors: 

1 .  Five  job  evaluation  factors  (M  anagement.  Planning,  Special  Training  and  Work  Experience. 
Judgment  and  Decision  Making.  Communication  Skills). 

2.  Two  job  organizational  level  variables  (Level  of  Organization  in  W  hich  Job  Occurs  and  Level 
of  Job  within  Organization). 

3.  M  ean  grade  rating  by  field  judges.  The  mean  of  the  grade  ratings  for  each  job  obtained  from 
five  field  judges  on  the  16-point  scale. 

4.  Supervisor's  judgment  of  appropriate  grade.  A  statement  by  the  supervisor  of  the  job.  taken 
from  the  job  description,  concerning  the  appropriate  grade  level.  Although  collected  as  a  scaled 
variable  (7  =General,  2  =  Lieutenant),  this  predictor  was  used  in  the  equation  as  six  categorically- 
coded  variables  to  increase  prediction  efficiency. 

Since  the  job  evaluation  factors  underwent  subsequent  modification  (i.e..  development  of 
benchmark  scales)  and  the  policy  equation  was  further  refined  in  the  later  application  by  METs. 
supplemental  description  of  (he  nine  predictor  variables  is  deferred  until  later  in  the  report. 
However,  certain  points  regarding  the  predictive  efficiency  and  rationale  of  the  predictor  variables 
included  in  the  equation  warrant  attention  presently. 

Although  the  Policy  Board  ratings  were  predicted  very  well  using  the  fix  e  job  evaluation  factors 
in  combination  with  the  two  organization  variables  (correlation  =.84).  it  would  be  difficult  to  prove 
that  these  particular  variables  were  the  ones  considered  by  the  Policy  Board  in  making  their  grade 
judgments.  Since  these  seven  variables  have  high  “face  validity"  for  grade,  and  they  accurately 
predicted  the  Policy  Board's  derisions,  it  was  assumed  that  they  are  primary  determiners  of  grade 
requirements.  W  hile  the  mean  grade  rating  from  five  field  judges  had  the  highest  relation  with  the 
criterion  for  a  single  variable  (r  =.89).  one  should  recognize  that  in  making  their  ratings  these  judges 
also  considered  information  measured  by  the  job  evaluation  factors,  such  as  the  management  and 
organizational  levels  of  jobs,  along  with  their  requirements  for  planning,  derision  making,  special 
work  experience,  and  communication  skills.  In  fact,  the  five  job  evaluation  factors  in  combination 
with  the  two  organizational  variables  correlated  .92  with  the  grade  ratings  obtained  from  all  field 
judges.  Even  so.  grade  ratings  obtained  from  field  judges  made  a  unique  contribution  in  predicting 
the  Policy  Board  ratings.  This  was  believed  to  be  due  to  a  large  number  of  special  factors  associated 
with  specific  jobs  which  were  considered  by  the  Policy  Board  and  by  the  field  judges  in  arriving  at 
grade  requirements.  Since  any  one  of  these  factors  might  apply  to  only  one  or  two  jobs,  it  would  be 
uneconomical  to  develop  scales  for  applying  them  to  all  jobs. 

The  supervisor’s  judgments  concerning  grade  made  a  very  small  unique  contribution  to  the 
system.  However,  this  contribution  was  believed  due  to  an  occasional  job  requirement  factor 
considered  by  the  supervisor  and  the  Policy  Board  but  not  considered  by  the  field  judges. 

When  the  policy  equation  was  applied  to  jobs  in  the  3.575  case  criterion  sample,  it  was 
demonstrated  to  be  highly  accurate.  As  shown  in  Table  2.  the  policy  equation  pinpointed  82  percent 
of  the  jobs  in  this  sample  within  one-third  grade  level  of  the  ratings  assigned  bv  the  board  on  the  1 6- 
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(mini  scale  ami  within  two-thirds  grade  level  for  ‘Mi. 7  percent  of  the  join..  The  correlation  coefficient 
between  grades  allocated  by  the  poliev  equation  and  grade  ratings  provided  by  the  Policy  Board  was 
»)2. 

T able  2.  Accuracy  in  Prediction 
of  Policy  Boanl  Job  Ratings 
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U  ithin  1  grade  3557  *>*>.5 

%  ithin  I -1/71  grade  3572 

W  ithin  I  -2/1  grade  .1075  100.0 


As  stated  before,  the  nine  variables  in  the  final  equation  were  selected  after  examining  about  200 
potential  predictors.  To  evaluate  the  possibility  that  this  process  involved  a  capitalization  on  chance 
relationships,  the  criterion-predictor  data  were  randomly  divided  into  two  job  subsamples.  \  and  B.  least 
squares  weights  for  the  nine  final  predictors  were  developed  in  sample  \  and  cross-applied  to  sample  B 
Similiarly.  weights  were  developed  in  sample  B  and  cross-applied  to  sample  V  The  resulting  shrinkages  in 
multiple  correlations  (Ws)  averaged  less  than  one  point  in  the  third  decimal  place. 

In  summary,  the  data  indicated  that  the  policy  equation  was  stable  and  that  it  did  an  excellent 
job  of  assigning  grades  judged  appropriate  by  the  Policy  Board  Krrors  were  few  in  number  and  small 
i"  magnitude.  In  view  of  these  findings,  the  (KiH  project  moved  to  the  next  phase 

Phase  ID:  Application  of  the  Policy  Equation 
to  IIMMMH'.ase  Sample  and  Projection  of  Results 

\fler  the  policy  equation  had  been  developed  and  demonstrated  to  assign  the  same  grades  to 
jobs  as  dill  the  I  olicy  Board.  Phase  III  was  undertaken.  This  phase  involved  application  of  the 
equation  to  determine  the  appropriate  grade  levels  for  a  sufficiently  large  number  of  jobs  to  serve  as 
a  base  for  estimating  the  appropriate  distribution  of  grade-  in  various  specialties  and  specialty 
groupings,  len  thousand  jobs  were  selected  for  inclusion  in  this  base  sample.  Of  these.  1.750  were 
selected  from  the  original  .I..i7.>  criterion  job  sample  so  the  policy  equation  could  he  rev  alidated.  The 
remaining  8.2. >0  jobs  were  new  jobs  selected  from  the  70.750  population  file  to  provide  adequate 
representation  of  every  \KS0-by-l  M  I)  grade  category.  Ocscriptions  for  the  10.000  jobs  were 
randomly  sorted  into  KM)  booklets,  each  containing  25  job  descriptions.  Kach  booklet  was  rated  bv 
not  fewer  than  five  majors  and  lieutenant  colonels,  who  were  selected  at  random  throughout  the  Air 
lorce.  Wmiil  2.IMMI  rating  officers  participated  in  this  phase  of  the  project  Kach  officer  rated  each 
job  in  the  booklet  on  the  job  evaluation  factors  and  tile  same  l(i-poinl  grade  scale  as  used  bv  the 
Policy  Board  hi  making  its  grade  determination 


r 


L 


Mean  score  values  on  (he  job  evaluation  factors  and  field  grade  ratings  were  combined  by  the  policy 
equation  with  organizational  variables  and  supervisory  ratings  to  determine  the  appropriate  grade  level 
for  each  of  the  KMHMI  jobs.  The  grades  assigned  bv  the  policy  equation  to  the  1.750  criterion  jobs  were 
compared  with  the  grades  assigned  to  these  same  jobs  by  the  policy  equation  using  ratings  collected  from 
field  j  udges  in  the  development  sample.  These  two  sets  of  grade  requirements  correlated  .03  and  had 
approximately  equal  means  and  standard  deviations.  Thus,  the  policy  equation  was  shown  to  have  high 
stability  across  time  and  judges. 

At  this  stage  of  the  OCR  project,  appropriate  grade  requirements  had  been  determined  for  11.825 
officer  jobs.  From  this  large  sample  of  job  descriptions,  which  had  been  collected  and  rated,  it  was  possible 
to  make  projections  as  to  how  the  grade  structure  of  the  Air  Force  might  change  if  the  policy  equation  was 
universally  applied  to  determine  appropriate  grades  for  jobs.  Kssentially.  this  sample  was  used  as  a  base  to 
determine  the  appropriate  distribution  of  grades  for  various  specialties  and  specially  groupings. 

Results  of  the  OCR  project  projections  indicated  that  changes  in  grade  allocations  would  have  to  be 
made  in  many  officer  utilization  fields  to  bring  statements  of  grade  requirements  into  line  with  job 
demands.  In  some  utilization  fields,  grade  requirements  appeared  to  be  overstated:  in  others  they  were 
understated.  In  every  utilization  field,  some  jobs  were  overclassified  while  others  were  underclassified  by 
grade  level.  Overall,  the  OCR  project  indicated  that  the  Air  Force  was  somewhat  undergraded  at  the 
colonel  level  in  IWvl.  and  considerably  undergraded  at  the  major  level. 

Regarding  subsequent  application  of  findings,  the  OCR  results  had  an  impact  on  allocations  of  grades 
to  officer  positions,  although  they  were  nut  implemented  across-the-board.  A  number  of  aircrew 
lieutenant  colonel  positions  were  downgraded  to  major  and  some  major  positions  in  other  areas  (e.g.. 
communications-eleclronics)  were  upgraded  to  lieutenant  colonel.  For  several  years  after  the  study.  OCR 
results  were  used  to  evaluate  requests  for  upgrading  from  the  field.  The  OCR  project  also  was 
instrumental  in  convincing  the  Department  of  Defense  of  the  need  for  supporting  an  Air  Force  request  for 
temporary  grade  relief. 
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Al  hile  the  OCR  project  produced  appropriate  distributions  of  grades  for  various  officer 
utilization  fields  and  for  the  total  force,  it  did  not  provide  a  grade  evaluation  proceduie  which  could 
be  applied  to  individual  officer  positions.  Previous  research  on  context  effects  indicated  that  the 
most  accurate  ratings  of  job  level  are  obtained  w  hen  a  job  is  considered  with  other  jobs  of  varying 
content  and  level.  Al  hen  a  job  is  rated  with  high  level  jobs,  it  lends  to  be  underestimated:  when  >1  is 
rated  with  low  level  jobs,  it  lends  to  be  overestimated.  In  the  OCR  study,  context  effects  were 
controlled  by  making  sure  that  when  job  or  job  factor  ratings  were  collected,  the  rater  s  judgments 
were  always  executed  on  a  carefully  selected  set  of  jobs. 

In  order  to  develop  a  system  for  evaluating  individual  officer  positions,  it  first  was  necessary  to 
construct  job-factor  scales  with  carefully  anchored  rating  levels.  That  is.  the  rating  scales  had  to 
provide  raters  with  an  appropriate  context  within  which  to  nest  their  judgments.  In  tbc  case  of  the 
<M,R  factors,  a  decision  was  made  to  develop  scales  using  generally  recognized  job  titles  as 
benchmarks  for  level  definitions.  The  efficiency  of  the  «.  ales  could  then  he  tested  through 
application  to  a  sample  of  jobs  from  the  original  <HiR  study. 
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For  a  comprehensive  review  of  benchmark  scale  development,  the  Brokaw  and  Ciorgia  (i960) 
study  should  be  examined.  The  following  paragraph  summarizes  the  major  accomplishments  and 
findings  from  the  report: 

A  M*t  of  job  requirement  factor  scale*  based  upon  a  benchmark  wale  presenting  job  title* 
to  identify  successive  levels  of  requirement  were  derived.  These  scales  were  applied  to 
1000  Air  Force  officer  position  descriptions  collected  and  previously  applied  in  the 
Officer  Orade  Requirements  study.  Comparison  of  rating  distributions  based  upon 
adjective  scales  and  the  benchmark  scale*  revealed  lower  mean  values,  larger  standard 
deviations,  and  superior  r.ero-order  validity  of  the  ratings  based  on  the  benchmark  scales. 

The  predictive  efficiency  of  optimal  composites  of  the  benchmark  scales  for  both  full  set* 
of  factors  and  the  subset  chosen  for  application  in  the  Officer  Crade  Requirements  study 
was  equivalent  to  that  of  the  adjective  wales.  A  set  of  integer  weights  for  use  in  field 
application  of  the  equation  was  derived  without  significant  loss  of  validity.  (Brokaw  A 
(•iorgia.  IW><>.  p.  10) 

To  show  adequate  information  for  present  purposes,  an  abbreviated  version  of  a  factor 
benchmark  scale  is  presented  in  Figure  I.  As  explained  subsequently,  the  factor  benchmark  scales 
were  updated  during  the  1974  M  FT  0(1  R  application.  In  addition,  further  explanation  and  examples 
of  the  benchmark  scales  are  provided  for  the  1976  test  and  projection  research  effort. 


FACTOR  1:  FORMAL  EDDC  ATKIN:  The  amount  of  formal  eduration  required  by  the  job.  Consider 
the  education  obtained  in  high  school,  college,  university,  or  professional  school. 

LEVEL  9 

Chief.  Computer  Techniques  Div.  Hq  Air  Weather  Service 
Industrial  Flngineer.  Hq  Air  Rase  Wg 

Chief.  Re-entry  Vehicle  l)iv.  Strategic  Missile  F. valuation  Sq 
LEVEL  8 

Nuclear  Research  Officer.  Research  Technology  Div.  AF  Flight  Dynamics  Lab 

Chief.  Military  Affairs  A  Asst  Staff  Judge  Advocate.  Air  Base  Op 

Chief  Physiological  Chemistry  Dept.  I  SAF  School  of  Aerospace  Medicine 

• 

LEVEL  2 

Chief  Transportation  Traffic  Management.  Transportation  Sq 
Croup  Supply  Officer.  Aeromedical  Evacuation  Op 
Base  Fuels  Officer.  F  ighter  W  g 

LEVEL  I 

Automotive  Maintenance  Officer.  Transportation  Sq 
Food  Service  Officer.  Combat  Support  Op 
Clothing  Sales  Officer.  Combat  Support  Op 


Figure  /.  Abbreviated  F.xample  of  a  Benrhmark  Seale. 
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On  completion  of  the  benchmark  scale  research,  a  grade  evaluation  technology  had  been 
developed  and  partially  tested  and  could  be  applied  to  individual  officer  positions.  For  a  fully 
operational  technology,  one  further  step  needed  was  the  construction  of  an  equi-perccntilc 
conversion  table.  While  the  predicted  composite  score  generated  bv  the  benchmark  scale  equation 
could  he  used  to  order  jobs  from  high  to  low  merited  grade,  a  conversion  table  was  needed  to  convert 
predicted  composite  score  values  into  specific  grade  levels.  The  conversion  table  was  needed  to 
insure  that  the  technology  would  assign  the  same  distribution  of  grades  to  a  set  of  positions  as  would 
have  been  allocated  to  those  positions  by  the  l%4  Policy  Board. 

Since  the  Air  Force  did  not  elect  to  operationally  implement  the  (HiR  technology,  the 
conversion  table  was  not  developed.  The  reasons  why  the  0(7  R  technology  was  not  implemented  are 
unknown.  Regardless  of  reasons,  since  the  technology  was  not  implemented,  further  officer  grade 
requirements  research  was  held  in  abeyance.  This  condition  held  until  1474. 
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During  I1)’!,  a  request  (RPR  74-20)  was  received  from  HQ  l  SAF  for  the  development  and 
testing  of  a  system  by  which  MF.Ts  could  evaluate  grade  requirements  for  individual  officer 
positions,  based  on  job  content  and  responsibility.  Essentially,  this  research  involved  the 
development  of  a  technology  by  which  MKTs  could  apply  job  evaluation  factors  to  determine 
appropriate  grade  requirements  for  non-aircrew  positions  and  used  the  previously  described 
yardstick  (0(7 R  policy  equation)  and  benchmark  scaling  procedure  for  individual  officer  positions. 
To  lie  the  proposed  system  to  the  Board  policy  .  M  FT  members  provided  ratings  on  a  subset  of 
positions  from  the  3 .S 7 criterion  sample.  I  sing  ratings  obtained  on  benchmark  factor  scales  and 
simplified  integer  weights,  grade  composite  scores  eould  he  correlated  with  the  original  Policy  Board 
grade  ratings.  An  additional  sample  of  current  jobs  and  MF.T  ratings  could  he  used  to  indicate 
whether  the  procedure  yielded  a  distribution  of  grade  requirements  different  from  I  I >  1 .  specified 
requirements. 

The  initial  effort  in  the  1*174  MF.T  study  involved  updating  the  10  benchmark  scales  (e  g., 
changes  in  job  titles  to  reflect  organizational  or  equipment  changes).  Instructions  and  forms  were 
developed,  and  two  job  subsamples  were  specified.  The  first  sample  consisted  of  185  positions  from 
the  benchmark  study  previously  rated  by  the  l‘K>4  policy  hoard  and  deemed  to  still  exist  in  the  Air 
Force  job  inventory.  The  second  sample  consisted  of  l.(>87  current  positions  selected  to  he 
representative  of  the  existing  Air  Fotce  population  of  non-aircrew  jobs.  Eighty -nine  MKTs 
participated  in  the  data  collection  phase  (a  total  of  <><>5  MF.T  members).  Each  MET  was  asked  lo 
collect  a  specified  subset  of  current  descriptions  and  to  rale  these  descriptions  and  another  subset  of 
reproduced  descriptions  from  the  185-position  sample.  Ratings  for  each  position  were  obtained  on 
the  III  updated  benchmark  scales  and  the  l(>-point  grade  rating  scale  (Table  I). 

The  first  set  of  data  analyses  was  designed  to  evaluate  w  hether  information  collected  by  M  F  I  s 
produced  a  grade  composite  having  a  high  correlation  with  the  Policy  Board.  Analyses  conducted  on 
the  185-position  sample  involved  weighting  together  the  MF.T  grade  and  five  benchmark  scale 
ratings,  together  with  supervisory  grade  ratings  and  organizational  level  variables.  The  second  set  of 
analyses  involved  apply  ing  the  equation  to  the  I  .(>87 -position  sample  and  comparing  (Mi  R  equation 
grades  to  present  job  incumbent  grades  and  l  III.  authorized  grades.  Additional  analyses  of  the  yob 


sets  also  were  conducted  to  determine  the  t»*v **i  of  inlerrater  a|>rmi)i'nt  on  ratings.  Those  analvses 
indicated  M  I  I  raters  could  reliably  rale  both  old  and  new  job  descriptions  and  provided  very  stable 
estimates  of  grade  requirements. 


Analyses  of  the  IMfi-job  sample  indicated  that  MKTs  could  accurately  implement  the  I •><> T 
board's  grade  "policy  "  (validity  of  grade  evaluation  composite  -.*>0).  Analyses  of  the  l.bHT-posilion 
sample  indicated  that  if  the  sv  stein  were  implemented,  it  would  reflect  fewer  colonel  and  lieutenant 
colonel  positions  and  more  major  positions  than  currentlv  authorized  (l  I > I . ) .  These  projections 
were  considered  extremely  tenuous  however  due  to  the  small  base  sample  and  the  weak 

conversion  table  based  on  onlv  IH  i  jobs. 


Kecom mendalions  stemming  from  the  |1?K  MKT  studv  were  as  follows: 


I.  If  Air  Force  management  wished  to  implement  a  system  for  evaluating  grade  requirements,  the 
previouslv  described  technologv  was  recommended  for  consideration. 


2.  Before  tile  technologv  became  operational,  it  would  be  necessarv  'or  MKTs  to  evaluate 
another  larger  set  of  jobs  (  — 1 .000)  from  the  original  criterion  sample  in  order  to  develop  a  stable 
conversion  table  for  translating  composite  scores  into  grade  decisions. 


.!.  1 1  the  \  ir  Force  w  isbed  to  determine  the  total  distribution  of  non -aircrew  grade  requirements, 
evaluations  on  approximated  10.01)11  additional  officer  positions  by  MKTs  would  be  needed. 
I'rojeclions  from  this  base  could  be  used  to  dclemine  grade  requirements  for  each  non-aircrew 
officer  ulili/.alion  field. 
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I  hiring  <  Ictober  I  *> T."i .  research  was  started  oil  a  request  (HI’R  7.’»-2l).  tilled  I felerill illation  ol 
Officer  t.rade  Kequirements  Based  oil  Job  t.onlent  and  Responsibility.  I  he  major  purpose  of  the 
research  was  to  extend  development  of  the  (K.K  technologv  for  M  FT  determination  of  appropriate 
distribution  ol  grade  aulhori/ations  for  non-aircrew  officer  career  fields.  Specific  objectives  were  as 

follow  s 

I  To  develop  a  stable  grade  conversion  table  suitable  for  operational  usage.  The  conversion 
table,  which  is  an  integral  part  ol  the  technologv.  was  not  fill  I  >  developed  in  previous  research. 

1  To  applv  the  (H;K  technologv  to  an  adequate  sample  of  officer  positions  as  necessary  to 
project  estimates  of  grade  requirements  lor  v  arums  utilization  fields  and  the  total  non-aircrew  officer 
force 

1  To  make  comparisons  of  projected  Ot.R  and  current  I  I  *  I  requirements  and  examine  tile 
impact  of  implementing  the  ttt.H  technologv  on  the  current  non-aircrew  officer  grade  structure. 

Ilesign  of  the  1 17b  HFI  IH.H  1‘rojorl 

The  I'tTti  MK  T  Ot.R  project  was  based  on  the  previouslv  described  research  which  had 
jiro v  ided  a  grade  v  ardstu  k  (integer  w cightcd  t  M.  R  equation ) .  factor  benchmark  scales  lor  ex  aluatiug 
individual  jmisiIioiis.  and  certain  modifications  made  during  the  I'l.l  MKI  study.  Basically,  the 
I  <-■  bnologv  assigned  a  grade  lev  el  to  a  position  w  hub  is  I  lie  same  as  w  mild  have  been  assigned  to  a  job 
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of  equivalent  content  and  responsibility  by  the  Board  which  established  policy  in  1064.  The  primarv 
definers  of  grade  in  the  OGR  equation  which  had  been  identified  up  to  this  point  in  the  stream  of 
research  were  as  follows- 

1 .  Manage m  enl:  The  level  of  executive  and  managerial  skills  required  in  the  job.  Consider  the 
complexity,  variety,  and  level  of  the  activities  which  are  directed,  organized,  coordinated, 
controlled,  commanded,  or  evaluated. 

2.  Planning:  The  extent  to  which  planning  is  required  by  the  job.  Consider  the  scope  and 
significance  of  work  for  which  planning  is  done.  The  longer  the  time  span  for  which  planning  is 
done,  the  higher  the  rating  should  be. 

3.  Special  T rain  ing  Work  Experience :  The  extent  to  which  the  job  requires  knowledges  and 
skills  which  must  be  acquired  through  special  training  courses  or  on-the-job  experience.  Disregard 
general  courses  given  by  Squadron  Officer  School.  Air  Command  and  Staff  College,  or  Air  War 
College. 

4.  Judgment  and  Decision  Making:  The  importance  and  independence  of  judgments  and 
decisions  required  by  the  job.  Consider  the  nature,  variety,  and  possible  impart  of  decisions.  The  less 
well  defined  the  guidance  for  decisions,  the  higher  should  be  the  rating;  while  the  more  specific  and 
detailed  the  guidance,  the  lower  should  be  the  rating. 

5.  Com  m  unication  Skills:  The  extent  to  which  the  job  requires  skill  in  oral  and  written 
communication.  Consider  the  complexity  and  variety  of  information  communicated,  as  well  as  the 
level  of  the  individuals  and  agencies  involved. 

It.  Level  of  O  rganizalion  in  Which  Jolt  Occurs. 

7.  Level  of  Job  K  ithin  Organization. 

In  addition,  ratings  of  appropriate  grade  from  supervisors  and  MKT  members  had  been 
weighted  into  the  equation  to  take  into  account  special  factors  occurring  in  some  jobs  which  were  not 
reflected  in  the  seven  preceding  primary  grade  definers.  As  previously  implied,  the  possibility  of 
excluding  one  or  both  of  these  variables  was  considered.  For  the  present  project,  a  critical  re¬ 
examination  of  the  M  FT  mean  grade  rating  predictor  variable  was  considered  necessary  in  order  to 
evaluate  its  potential  impact  on  an  operationally  implemented  technology. 

In  the  present  application,  it  was  necessary  to  obtain  factor  ratings  from  MFT  members  on  an 
adequate  subset  of  positions  from  the  original  3,575  criterion  job  sample.  Composite  scores  resulting 
from  application  of  the  OGR  equation  could  then  be  compared  with  grades  assigned  by  tbe  Policy 
Board,  in  order  to  confirm  that  the  grade  yardstick  was  applied  in  a  consistent,  reliable,  and  valid 
manner  by  M  FT  raters.  This  subset  of  “criterion  jobs"  could  also  be  used  in  the  construction  of  an 
equi-percentile  conversion  table  to  determine  the  cutting  points  (for  composite  scores)  separating 
adjacent  grade  levels  so  as  to  yield  the  same  distribution  of  grades  to  a  job  sample  as  would  have  been 
allocated  by  the  Policy  Board.  Fssentially.  the  grade  composite  plus  the  conversion  table  form  the 
system  for  evaluating  the  appropriate  grade  level  of  each  non-aircrew  officer  position.  A  liighlv  valid 
composite  offers  assurance  that  the  right  jobs  are  assigned  into  each  grade  category;  while  the 
conversion  table  assures  that  the  correct  number  of  jobs  are  assigned  to  each  grade  category. 

I  n  addition,  a  large  sample  ( =4  1 .000)  of  current  jobs  was  collected  and  rated  in  order  to  evaluate 
the  level  of  agreement  among  M  FT  members  and  to  serve  as  a  basis  for  projection  of  requirements  to 
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the  total  non-aircrew  force  and  various  officer  utilization  fields.  If  there  was  high  agreement  among 
raters  (i.e..  high  reliability),  considerable  confidence  could  be  placed  in  composite  scores  derived 
from  MET  raters  and  used  as  a  basis  for  projection  to  the  total  non-aircrew  force. 

After  development  of  a  stable  conversion  table  and  projections  of  requirements,  various 
comparisons  were  possible  to  evaluate  the  impact  of  implementing  the  technology.  The  (KIR 
projected  grade  requirements  could  be  compared  to  Air  Force  Manpower  and  Organization  (M  A  O) 
V  nit  Detail  Listings  (I’DL)  authorized  grade  requirements  both  with  regard  to  the  total  non-aircrew 
force  grade  structure  as  well  as  specific  officer  utilization  fields  or  special  dutv  A ESC  (DAFSl.) 
groupings.  These  utilization  field  comparisons  could  he  used  to  indicate  areas  or  AFSl'.  groupings 
where  adjustments  in  grade  requiements  should  be  considered.  In  addition.  OCR  projected 
requirements  could  also  be  compared  to  current  on-board  grade  distributions  (i.e..  from  l  niform 
Officer  Records  (LOR)).  These  comparisons  (OCR  vs.  present  LOR  grade  distribution)  were 
considered  desirable  in  the  event  of  possible  differences  between  l'  It I.  authorized  and  on-board 
grade  structures.  For  all  comparisons,  the  main  precaution  to  recognize  in  determining  the 
"fineness"  or  level  of  comparison  (e.g..  two-character  AFSC  or  utilization  field  or  four-character 
D.AFSC)  was  the  adequacy  of  the  job  sampling  base  used  for  projections. 

There  were  seven  major  steps  involved  in  the  grade  determination  process  for  the  1070  OCR 
project.  These  were  (a)  reproduction/collection  of  job  descriptions.  ( b)  identification  of  MKTs  and 
MET  raters,  (c)  obtaining  job  factor  and  grade  ratings,  (d)  development  of  policy  equation 
(regression)  weights,  (e)  determination  of  grade  composite  scores,  (f)  development  of  a  stable 
conversion  table,  and  (g)  conversion  of  composite  scores  to  grade  equivalents.  These  steps  are  next 
described.  After  the  last  step  in  the  process,  projections  of  grade  requirements  to  the  non-aircrew 
force  were  accomplished. 

Job  Samples  and  Data  Collection 

As  indicated,  the  present  project  required  two  samples  of  job  descriptions.  The  first  sample 
consisted  of  1.725  job  descriptions  for  non-aircrew  positions  from  the  1001  criterion  jobs  (5.575) 
which  were  screened  and  judged  to  represent  positions  still  in  the  Air  Force  inventory.  The  second 
sample  consisted  of  approximately  1 1.000  current  jobs  identified  for  collection  by  M  ETs  from  job 
incumbents.  For  the  1.725  descriptions,  copies  were  reproduced  for  subsequent  use  by  MKTs,  l  or 
the  1 1.000  jobs,  sampling  specifications  by  M  ETs  were  established,  with  current  positions  stratified 
across  DAFSC.  and  grades  (lieutenant  through  colonel)  in  order  to  assure  that  descriptions  collected 
were  representative  of  the  non-aircrew  force.  The  sample  of  current  job  descriptions  collet  ted 
contained  one  or  more  jobs  from  each  of  five  LDL  grades  by  51  utilization  field  (2-character  \FS(  ) 
categories.  Larger  numbers  of  descriptions  were  collected  for  more  populated  categories.  Sample 
specifications  for  current  position  descriptions  were  based  on  a  December  1*175  l  Dl.  non-aircrew 
utilization  field-by-grade  population  (02.002  positions)  provided  by  IK)  l  SAF  Manpower  and 
Organization  (Mtt  ()). 

There  were  122  M  ETs  participating  in  the  collection  of  job  descriptions  and  factor  ratings  from 
Januarv  to  March  1070.  These  METs  were  from  22  major  commands,  were  located  both  overseas 
and  the  zone  of  interior,  and  involved  *150  manpower  and  management  engineering  raters  (officers, 
airmen,  and  civilians).  Packages  of  material  were  prepared  and  distributed  to  each  MET.  including 
instructions,  grade  by  D.AFSC.  job  sample  specifications,  reproduced  copies  of  current  position 
description  forms,  benchmark  factor  scales,  and  rating  forms.  Each  of  the  122  METs  was  asked  to 
collect  position  descriptions  for  a  specified  subset  of  the  current  or  new  job  sample  (i.e..  from  about 
1  5  or  20  to  500  descriptions  depending  on  base/organization  size) .  A  n  example  of  an  officer  position 
description  form  is  given  in  Appendix  A.  Job  incumbents  were  asked  to  complete  the  position 
description  form  according  to  instructions,  then  forward  it  to  their  supervisor  who  provided  a 


judgment  of  appropriate  grade  for  the  job.  There  were  100  larger  MF.Ts  (i.e..  seven  or  more  raters 
available)  whirl)  were  asked  to  furnish  ratings  fur  the  subset  of  reproduced  descriptions  provided  by 
AFIIHI.  from  the  criterion  job  sample.  Two  copies  of  this  set  were  reproduced  and  divided  so  that 
each  description  could  be  rated  by  two  different  M  FT  organizations. 

After  collection  and  processing  of  position  descriptions.  MKT  raters  were  asked  to 
independent!)  rate  specified  subsets  of  job  descriptions  (both  criterion  sample  and  current  jobs) 
according  to  prescribed  directions.  Kaeli  rater  was  instructed  to  rate  jobs  using  the  10  job  evaluation 
factor  benchmark  scales  and  1 6-point  grade  code  scale.  The  five  benchmark  scales  entering  into  the 
(Hi  K  policy  equation  are  shown  in  Appendix  B  (i.e.,  factors  2.  5.  7.  8.  and  *)).  Job  rating  forms,  with 
job  numbers  pre-listed  by  M  KT  project  officers,  were  provided  for  raters  to  enter  their  job  factor  and 
grade  code  ratings.  Job  descriptions  were  arranged  into  folders  so  that  page  1  background 
information  was  not  visible  with  each  folder  containing  approximately  25  descriptions. 

Factor  and  grade  ratings  were  obtained  from  an  average  of  1 3.61  raters  for  the  1 .725-job  sample. 
An  average  of  6.05  MKT  raters  provided  such  data  for  the  11.321  current  position  sample  (i.e.. 
composed  of  0.631  jobs  for  the  1076  cycle  and  1.687  from  1071  cycle).  In  summary,  data  were 
available  for  a  total  of  13.016  non-aircrew  officer  position  descriptions  (1  1.321  +  1.725)  for  the 
present  study. 

MKT  Application  of  OCR  Technology 
to  Criterion  Job  Sample 

After  receipt  and  screening  of  data  (job  description  and  ratings)  from  the  122  M  KTs.  analyses 
were  accomplished  concerned  with  a  critical  re-examination  of  the  OCR  policy  equation, 
determination  of  optimal  integer  weights  for  each  predictor  variable,  evaluation  of  the  validity  or 
predictive  efficiency  of  the  policy  equation,  and  development  of  a  stable  conversion  table.  These 
analyses  and  findings,  based  on  data  for  the  1.725  job  sample,  were  as  follows. 

Ouring  the  |07f  MKT  OCR  study,  a  nine-variable  simplified  integer  weighted  policy  equation 
was  designed  to  evaluate  whether  information  collected  by  M  KTs  produced  a  grade  composite  score 
hav  ing  a  high  correlation  with  the  1061  Policy  Board.  This  equation  was  developed  on  a  185  job 
sample  and  involved  weighting  the  grade  and  benchmark  factor  scale  ratings  provided  by  MKTs, 
together  with  supervisory  grade  ratings  and  data  concerning  the  organizational  level  for  each 
position.  This  simplified  equation  had  a  composite  score  validity  of  .*>0  for  ihe  185  job  set.  which  w  as 
identical  to  that  obtained  for  1.00(1  jobs  in  the  1066  Benchmark  study,  and  only  slightly  lower  than 
the  validity  coefficient  of  .02  obtained  in  the  1061  study.  When  this  equation  was  applied  to  tin- 
1.725  job  sample  in  the  present  investigation,  it  y  ielded  a  composite  score  validity  of  .01. 

Although  the  nine-variable  policy  equation  yielded  high  validity  coefficients  when  applied  on 
four  occasions,  the  question  remained  open  regarding  the  inclusion  of  the  MKT  mean  grade  rating 
variable  in  an  equation  for  operational  implementation.  In  the  present  study  projections  were  based 
on  the  assumption  (hat  MKT  raters  would  apply  the  OCR  technology  in  the  future  in  the  same 
manner  as  applied  in  the  present  job  samples.  Any  tendency  for  raters  to  give  high  or  low  grade 
estimates  on  the  16-point  scale  did  not  create  a  problem  in  determining  grades  for  the  I  1.000-ease 
sample  since  the  conversion  table  automatically  adjusted  for  any  rating  biases.  However  if  the  OCR 
technology  became  operational.  MKTs  would  receive  continuous  feedback  concerning  the  OCH- 
specified  grade  for  each  position  evaluated.  Consequently .  this  could  modify  the  raters’  frame  ol 
reference  such  that  they  would  tend  to  bring  their  grade  ratings  into  alignment  with  anticipated 
equation  results.  In  order  to  protect  against  this  possibility .  the  decision  was  made  to  eliminate  M  F.  I 


grade  ratings  from  an  o|»'rational  version  of  the  policy  equation,  provided  there  was  little  if  am  loss 
in  validity  or  predictive  efficiency.  The  supervisors' judgment  of  grade  variable  was  retained  in  the 
equation  since  supervisors  would  not  he  involved  in  the  continuous  feedback  process  as  were  M  FT 
raters. 

Vn  eight-variable  policy  equation  with  optimal  integer  regression  weights  was  developed  as 
shown  in  Table  Vs  described  subsequently  this  optimally  weighted  equation  had  a  high  level  of 
predictive  efficiency  and  was  the  final  version  used  for  making  projections  to  the  non-aircrew  force. 
The  equation  consisted  of  the  five  MKT  rated  job  evaluation  factors,  two  level  of  organization 
v  ariahles.  and  the  supervisor's  judgment  of  appropriate  grade.  Although  supervisor’s  judgment  was 
taken  from  the  job  description  as  a  linear  variable,  it  was  used  in  the  equation  with  adjustments  to 
composite  score  weighted  lor  each  grade  as  shown  in  Table  3. 
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MKT-Applied  Integer  Weight  tirade  Equation 
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A  grade  conversion  table  based  on  1 .725  jobs  was  constructed  in  order  to  convert  composite  scores  to 
a  lb-point  experience  level  scale  and  a  5-point  grade  scale  (Table  5).  This  research  conversion  table  was 
necessary  to  determine  cutting  points  separating  adjacent  grade  levels  so  as  to  yield  the  same  distribution 
of  grades  to  a  job  sample  as  would  have  been  allocated  by  the  10bl  Policy  Board.  When  applied  to  the 
grade  equation  composites,  this  conversion  table  also  adjusts  for  restriction  in  range  due  to  regression 
effects.  Essentially  ,  the  validity  of  .00  assured  that  the  OCR  equation  assigned  jobs  in  the  correct  order  of 
merited  grade  and  the  conversion  table  assured  that  the  right  number  of  jobs  was  assigned  to  each  grade 
level. 
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Tbf  basic  concept  involved  ill  the  construction  of  the  equi-pereentile  conversion  table  was  to 
use  average  (mean)  grade  ratings  values  (Table  1)  of  the  1.72.")  jobs  assigned  by  the  I’olicv  Board  to 
establish  interval  cutoff  points  in  the  arrav  of  job  composite  scores  ranked  from  highest  to  lowest 
score  values.  Kssentialiv  the  procedure  assures  that  equal  percentages  or  the  same  number  of  jobs 
li  e  .  job  composite  scores  from  application  of  the  (MiR  equation)  are  assigned  the  same  experience 
level  (  Iti-point  experience  level  scale)  or  grade  level  (.'5-point  grade  scale)  as  given  by  Policy  Board 
ratings  lor  these  jobs.  For  example  (Table  5).  if  seven  jobs  were  rated  by  the  Policy  Board  as  upper 
level  colonel  positions  (1-1.5  and  above),  then  a  corresponding  number  of  jobs  would  he  designated 
a-  upper  level  colonel  according  to  their  job  composite  scores  (i.e..  the  composite  score  for  the 
-cvenfh  lowest  job  would  be  used  as  the  interval  cutoff  score  between  upper  and  mid-level  colonel 
jobs).  Similar  logic  and  pro-  edure  were  used  to  determine  cutoff  points  (experience  level,  grade,  and 
job  composite  scores)  for  the  remaining  1.725  jobs. 

\fter  determining  the  preceding  intervals,  and  making  the  minor  adjustments  described 
subsequently,  the  equi-pereentile  conversion  procedure  was  then  applied  to  the  II. (MM)  case  job 
sample.  I  bis  technology  was  used  in  order  to  apply  a  standard  unit  or  system  measurement  to  the  job 
sample.  With  regard  to  this  procedure,  the  point  should  he  noted  that  this  conversion  process  does 
not  limit  the  number  of  jobs  within  experience  or  grade  levels.  Rather,  the  procedure  permits 
indiv  idual  jobs  to  change  grade  levels  according  to  changes  in  their  job  content  and  responsibility . 
Consequently .  if  some  specified  set  of  jobs  were  evaluated  at  two  different  time  periods,  the 
procedures  could  result  in  essentially  the  same  grade  distribution  or  a  different  grade  distribution, 
dependent  on  shifts  or  changes  in  content  or  responsibility  of  the  jobs. 

In  the  construction  of  the  conversion  table  based  on  1.725  jobs,  a  modification  to  prior  equi- 
pereentile  conversion  table  development  procedures  was  necessary  to  account  for  the  smaller  job 
sample  size.  In  the  initial  0(5 R  project,  using  the  criterion  job  sample  (5.575).  a  1 6-point  conversion 
table  was  developed  which  resulted  in  cutoff  intervals  between  experience  levels  which  were 
relatively  equal  (Hazel  el  al..  1666).  In  the  present  study,  the  intervals  between  cutoff  points  were 
slightly  irregular.  Minor  adjustments  were  made  by  fitting  a  quadratic  regression  equation  to  the 
interscore  intervals  and  then  changing  cutoff  points  slightly  in  the  research  conversion  table 
composite  scores.  (See  Finstuen  et  al..  1680.  for  details).  Within  the  range  of  composite  scores  shown 
in  Table  5.  the  maxim  tun  adjustment  at  any  interval  w  as  +  1 .2  points.  These  minor  changes  in  cutoff 
points  were  assumed  to  better  reflect  a  conversion  table  based  on  a  larger  job  sample. 

A  Iter  application  of  the  grade  conversion  table  to  the  composite  scores.  Figure  2  was  constructed 
to  display  the  relationship  between  grades  assigned  by  the  optimal  Policy  Equation  and  those 
assigned  by  the  1661  Policy  Board  to  the  1.725  jobs.  As  shown  in  Table  5.  three  points  on  the 
experience  level  scale  encompasses  one  grade  level,  except  for  lieutenants.  For  those  positions  in  the 
squares  with  a  diagonal  line  drawn,  there  was  exact  agreement  between  the  equation  and  hoard- 
assigned  grades.  Positions  plotted  one  square  off  the  diagonal  are  those  for  which  the  equation  and 
hoard  agreed  w  ithin  I  /5  grade  level.  Positions  plotted  two  squares  off  the  diagonal  were  in  agreement 
w  ithin  2/5  grade  level.  For  the  1.725  jobs.  ‘>4%  (1614)  of  the  jobs  were  in  perfect  agreement  or 
within  2/5  grade  level.  Of  the  remaining  jobs,  only  2%  (55  jobs)  were  in  disagreement  more  than  one 
grade  level.  In  brief,  the  MET  raters  were  able  to  accurately  implement  the  1664  criterion  board 
policy  using  the  optimal  integer  weighted  equation. 
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Converted  Composite  Score  from  Grade  Determination  Equation 

I  i^urf  2.  Comparison  of  grades  assigned  to  1.725  jobs  by  Air  ton  e 
Policy  Board  and  die  MET  applied  OCR  Policy  Equation. 

In  addition  to  the  validity  coefficient  (.00)  between  equation  composite  scores  and  hoard  grade 
ratings,  tile  relationship  between  converted  composite  scores  and  hoard  ratings  was  also  determined 
(r  -.80).  The  conversion  process  with  minor  adjustments  had  only  a  negligible  effect  on  the  validity 
"I  |>«*li<  >  equation.  In  addition,  there  was  a  high  relationship  between  the  MET  mean  grade 
ratings  and  llir  converted  policy  equation  scores  (r  =  .<)|). 

MKT  Hater  Agreement  on  l  1,000  i'.asv  Job  Sample 

Another  critical  question  regarding  MET  application  of  the  technology  was  the  stability  of  the 
values  used  for  projections  to  the  total  non-aircrew  force.  For  this  purpose,  the  level  of  agreement 
among  VIE  I  raters  lor  the  present  job  sample  (over  1  1.000  descriptions)  was  examined.  Interraler 
reliability  coefficients  were  computed  for  the  five  job  evaluation  factors  and  the  final  grade 
evaluation  composite  scores,  based  on  an  average  of  0.05  ratings  for  each  job.  Reliability  coefficients 
lor  the  factors  and  grade  composite  extrapolated  to  an  average  of  0.05  ratings  (It)  per  job  are  given  in 


I  able  (>.  I  he  reliability  ol  the  ov  t  rail  grade  com  pusilc  w  as  .'K.  indicating  a  high  level  of  agreement 
among  M  I  I  raters  concerning  content  an<l  responsibility  of  jolts  anil  stalile  values  (i.e..  mean 
com|tosite  'cores  ol  MIT  raters)  useil  lor  projections.  Ksscnliallv  the  obtained  staliilitv  estimates 
suggest  that  il  the  I  1 .000  current  jolt  sample  was  evaluated  hv  another  group  of  MKT  raters,  the 
probability  is  tpiile  high  thev  would  he  able  to  applv  the  technology  and  produce  similar  results  in 
terms  ol  mean  composite  scores. 
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Keliahililv  coefficients  were  also  determined  and  compared  for  the  type  rater  groups  lor  the 
present  jolt  sample  (7*>  I  enlisted.  18  f  civilian.  I  77  officer  raters) .  I  n  ter  rater  reliabilities  of  composite 
scores  were  computed  separately  lor  each  rater  group  based  on  jobs  with  two  or  more  ratings. 
Keliahililv  coefficients  (i.e..  stability  estimates)  derived  by  the  Spearman-Brown  prophecy  formula 
for  an  average  of  seven  raters  (h)  per  job  for  the  three  groups  are  given  in  Table  7. 


Tab  tv  7.  Keliuhilitv  foe  (lie  ic  tits 
for  lhree  (. roups  of  MKT  Halers 
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If  the  technology  w ere  operationally  implemented  hv  M  I  I  s.  it  is  estimated  that  the  validity  of 
,,,,  eight-variable  policy  equation  would  he  approximately  ,*M  as  reported  previously  lor  the  I,.  J  > 
job  sumpb  .  However  hv  accepting  certain  tenable  assumptions  (i.e..  statistical  relation  ol  validity 
and  reliability),  validity  in  an  operationally  implemented  system  mav  he  further  enhanced  hi 
uking  maximum  use  ol  ollicer  raters.  \s  show  u  in  I  .tide  < .  the  ratings  prov  tiled  hv  civ  than  M  I  I 

.ember'  were  slightly  more  reliable  than  those  provided  hv  enlisted  members,  and  . . Unci 

.Itings  were  more  reliable  than  those  provided  In  either  enlisted  or  civilian  rater' 
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Projections  from  11,000  Job  Sample 
to  Determine  INon-Airorew  Urade  Requirements 

Based  on  preceding  findings,  it  was  possible  to  estimate  w  ith  considerable  accuracy  the  results  i 

that  would  be  obtained  if  MKTs  were  to  apply  the  Oti R  technology  to  all  Air  Force  non-aircrew  i 

positions.  After  close  examination  of  the  present  job  sample,  there  were  1 1.102  jobs  identified  w  ith 
complete  information  on  all  necessary  data  elements  (i.e..  prescribed  1)  AFS('..  OUR  converted  grade. 

and  T  1)1,  grade  of  job)  needed  for  projections.  This  sampling  base  was  large  enough  to  provide  stable  j 

projections  for  the  total  non-aircrew  force,  large  groupings  of  specialties,  (i.e..  career  areas)  and  f 

various  officer  utilization  fields  (i.e..  2-character  AFSC.  levels).  j 

t; 

The  non-aircrew  popidation  to  w  hich  the  1 1.192  case  sample  was  projected  consisted  of  <>2.<>02  j- 

l  Dl,  authorized  officer  positions  identified  by  HQ  I’S  AF/M&  O  as  of  December  1975.  The  method  ; 

for  projecting  to  this  population  of  officer  positions  involved  the  determination  of  "population 

weights”  and  projections  from  sample  values  to  population  values.  The  essential  feature  of  the  I 

projection  procedure  for  a  hypothetical  specialty  (AFSC)  are  illustrated  in  Table  8. 

The  basic  sampling  units  for  OCR  projections  were  the  DAFSC-by-grade  (I'D),)  categories.  As  * 

a  first  step  for  projection  purposes,  an  associated  "population  weight"  was  determined  for  each  job  in  , 

the  11.192  case  sample.  For  example  if  a  certain  specialty  (I)AFS(')  population  contained  125  ! 

positions  at  a  certain  MS  O  l1  Dl,  grade  (e.g..  major),  and  if  there  were  25  jobs  in  this  11)1.  grade-bv-  ! 

DAFSC  category  in  the  OUR  sample,  then  each  of  the  25  jobs  in  the  sample  receives  a  population  , 

weight  of  five  (125/25  =  5.  see  Table  8).  Thus  each  of  the  jobs  in  this  category  of  the  sample  would 
represent  five  jobs  in  the  population. 

To  determine  the  appropriate  distribution  of  grade  for  a  particular  specialty,  the  next  step  was  to 
construct  a  two-way  table  in  which  rows  represent  OUR  prescribed  grades  and  columns  represent 
currently  authorized  l  Dl,  grades  of  jobs  (page  1  of  job  description).  The  following  step  involved  the 
multiplication  of  population  weights  times  sample  frequencies  in  each  OGRA’Dl.  grade  cell.  Those 
resulting  values  are  then  entered  into  a  population  distribution  table  for  a  specialty  (Table  8).  Bv 
combining  population  distributions  for  specialties,  projection  tables  can  be  constructed  for  various 
occupational  groupings  (e.g..  career  areas)  or  the  total  non-aircrew  force. 

Projection  Results  —  Total  INon-Aiirtvw  Fotve 

Tables  9  and  10  present  and  compare  estimates  of  grade  requirements  for  the  total  non-aircrew 
force  which  were  accomplished  by  sampling  17  percent  of  02.602  positions.  Table  0  is  a  two-wax 
distribution  ol  OUR  (rows)  versus  I '  I) I.  (columns)  grade  requirements.  Table  10  presents  the  OUR 
job  sample  used  for  projections.  11Q  I'SAF  M  &  ()  TDI,  values.  OUR  projected  grade  requirements, 
differences  between  MS  I)  l  Dl.  and  OUR  requirements,  and  on-board  grade  distributions 
(December  1075  and  June  1070  Uniform  Officer  Record  assigned  strength  figures).  For  reasons 
associated  with  development  of  the  conversion  table  discussed  subsequently,  data  for  captains  and 
lieutenants  have  been  combined.  Additionally,  the  tables  do  not  include  data  for  general  officers, 
students,  patients,  air  attaches,  line  pilots  and  navigators  and  officers  in  the  professional  medical/ 
dental  specialties. 

\ s  shown  in  Table  0.  of  the  1.789  I'  1)1.  authorized  colonel  positions,  only  5 . ,  2<>  were  correctly 
graded  according  to  job  content  and  responsibility  as  evaluated  by  the  OUR  equation.  I  his  means 
that  approximately  21  percent  (1015  jobs)  were  xxverclassificd.  However  I  able  0  reveals  that  >28 
I  Dl.  lieutenant  colonel  positions.  18  l  Dl,  major  positions,  and  four  captain/lieutenanl  positions 
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Table  8.  Illustration  ofSantple  to  Population 
Projections  Within  a  Specialty 
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Table  0.  Projected  Total  Non- Aircrew  Force: 
DDL  vs.  (KIR  Requirements 
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Table  10.  Comparison  of  (Irade  Requirement  for  Total  Non-Airerew  Force 
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would  lie  more  appropriately  graded  at  the  colonel  level  yielding  a  net  balance  of  163  more  DDL 
colonel  authorizations  than  the  requirements  determined  by  the  OCR  equation  (Table  10).  Thus, 
these  results  indicate  that  the  Air  Force  l  DL  stated  requirements  for  colonel  positions  is 
approximately  10  percent  loo  high.  However,  as  of  December  1075  (Table  10).  there  were 
approximately  1.306  colonels  in  the  active  duty  force  (FOR  ).  which  was  43.3  less  than  called  for  by 
the  I  111.  at  that  time  hut  .10  more  than  (MIR  requirements. 

The  preceding  results  suggest  that  grade  requirements  based  on  job  content  and  rcsponsihilin 
levels  would  accommodate  nearly  all  of  the  on-board  colonels.  Additionally,  the  (Mill  versus  on¬ 
board  comparisons  suggest  an  alternative  usage  of  the  OCR  technology.  Composite  scores  derived  for 
positions  could  he  used  for  more  finite  differentiation  in  the  assignment  process  at  all  grade  levels. 
I' or  example.  OCR  grade  composite  scores  could  he  used  to  identify  higher-level  lieutenant  colonel 
positions  which  could  serve  as  training  positions  for  colonel  selectees. 

Reference  to  I  able  10  also  reveals  that  the  OCR  recommendation  for  lieutenant  colonel  grades 
is  higher  than  the  I  1)1,  statement  for  such  grades,  and  more  than  balances  the  colonel  reduction.  The 
combination  of  requirements  for  colonel  and  lieutenant  colonels  was  I .r>.0<)7  as  defined  by  I  Dl,  and 
I.).2i0  for  OCR.  hither  of  these  requirements  would  accommodate  the  number  of  colonels  and 
lieutenant  colonels  on  active  duly  as  of  December  1075  or  June  1070  ( 1  F. !•.'»*♦  and  lf.001. 
respectively ). 
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\s  shown  in  Table  10.  tilt*  OCR  equation  indicates  a  requirement  for  5.460  more  majors  and 
5.63')  fewer  captains/licutcnants  than  called  for  l>\  the  l  1)1..  W  bile  the  (Hi  H  slated  requirements  for 
major  positions  may  he  eorreet  in  terms  of  the  eontent  and  responsibilities  assoeiated  with  these 
positions,  it  mat  not  he  possible  for  the  Air  Force  to  prodtiee  this  many  majors  from  the  stated 
eaplain/lieiitenant  base.  Mthough  separate  breakouts  are  not  provided  for  eaptains  and  lieutenants, 
the  poliev  equation  refleeted  a  requirement  for  considerably  more  captains  than  lieutenants,  which 
would  lie  even  more  unreasonable  to  implement. 

The  problem  is  generated  by  the  fact  that  the  1064  policy  board  recognized  very  few  non-aircrew 
positions  as  being  appropriately  filled  by  lieutenants:  yet  the  Air  Force  is  a  closed  system,  and  with  few 
exceptions  (e.g..  phy  sicians)  does  not  hire  eaptains  directly  from  the  civilian  sector.  For  this  reason,  it  may 
bo  necessary  to  identify  a  certain  proportion  of  the  lower-level  OCR  captain  positions  and  declare  them  to 
be  lieutenant  positions  on  the  l  1)1..  Similarly  ,  it  may  be  necessary  to  declare  a  small  proportion  of  the 
lower-level  OCR  major  positions  to  be  captain  positions  on  the  I'DI..  Such  actions  in  no  way  suggest  that 
the  requirements  stated  by  the  1064  policy  hoard  for  such  positions  are  incorrect;  rather,  it  is  a  recognition 
of  the  need  to  link  career  progression  programs  with  job  requirements  in  order  to  provide  reasonable 
promotion  points.  Since  the  OCR  equation  yields  a  continuous  distribution  of  composite  scores  reflecting 
the  responsibility  level  of  positions,  there  is  flexibility  in  defining  cutting  points  for  different  grade  levels. 
Consequently.  development  of  a  conversion  table  to  provide  an  appropriate  distribution  of  grades  at  the 
lower  levels,  as  specified  by  Air  Force  Management,  is  recommended.  The  development  of  such  a 
conversion  table  however  would  also  require  a  concurrent  examination  of  its  impact  on  grade 
requirements  in  various  officer  utilization  fields. 


Projection  Results  —Six  Career  Area  (Groupings 


Tables  1 1  to  l(i  present  comparisons  of  versus  OCR  grade  requirements  and  on-board  strength 
figures  (December  1075  and  June  1076  TOR)  for  six  career  area  or  specialty  groupings.  These  groups 
correspond  approximately  with  certain  career  areas  outlined  in  AFR  36- 1  (1077).  The  data  on  these  tables 
permit  the  comparison  of  l ' I >1..  OCR.  and  on-board  grade  requirements  and  detection  of  certain  general 
trends  or  differences  which  arc  not  observable  from  the  total  non-aircrew  force  distribution.  While  these 
groupings  reflect  the  impact  of  applying  the  OCR  technology  at  a  broader  level  of  occupational  groupings, 
any  observable  trends  should  be  considered  further  with  regard  to  specific  specialties  or  utilization  fields 
described  later  in  the  report.  The  values  in  Tables  1 1  to  1()  are  averaged  across  AFSCs  and  do  not  reflect 
the  wide  variations  that  may  appear  within  specialties. 
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Table  12.  Air  Operations  Area 


) 

I 


AFS<.s:  UXX.  I6XX,  I7XX.  18XX.  20XX,  21XX,  and  22XX 


I  OK 

Prrarnl  (»rade 


Mao 

1 1)1. 

(H.H 

IW  7.* 

June  7l» 

Sample  — 

(•rxlr 

Si*e 

N  % 

N  % 

Difference 

N  % 

N  % 

Table  /.».  Administrative  and  Support  Arran 
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Table  III.  Mrdiral  and  I’rnfenniniial  Arran 
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I'ahlr  17  provides  a  mi  in  mart  of  I  hr  (irrrrnlaffr  of  rhanprs  hi  grades  for  ill  r  six  arras  and 
supplements  Tahir*  II  through  ll».  Thr  pTreriitagr  of  change  rallies  ttrrr  drritrd  In  dmding  the 
differences  between  MaO  I  1*1.  and  (HiK  reipiireinents  hi  (hr  MftO  I  IH  rallies  (e.g..  'Tahir  II. 
( aiinmander/lhreetor  area.  tailonel  diffrrrnrr  -  -21 1/2080  which  xields  u  l  I  >1  limn  nt  -10  1  TV  hi  Table 
IT). 

\*  can  hr  srrn  in  I  ahlr  I..  if  OI.R  recommendations  ttrrr  iniplrnicnlrd.  one  arra  (\ir 
Operations)  would  hair  an  increase  in  cnlnnrl  authorisations.  whereas  four  arra-  (•  uinmandrr 
llireelnr.  I.ogislirs/M  alrrirl.  Vdininistralix  r.  and  M  rdieal/l'rnfessional)  would  lose  sonir  I  |t| 
colonel  authorisation*.  U  bile  ihr  (’.nniniander/llirrelor  \T>(  *  would  lose  llir  largest  in  actual 
number*  (-211).  lhr\  would  not  lone  (hr  moM  on  a  percentage  hams  (eg.  M  rdical/l’rolr»«ional 
-.I2'(i  .  actual  loss  -100).  The  Scirnlific/T  iigiiirrriug  arra  would  rrrrnr  a  small  I  appro  x  nil  alii  t 
l"n  )  increase  in  colonrl  authorisation*.  Tor  ihrrr  arras  (  \  ir  Operations.  .V  iciilific  T  ngiiiccniig.  and 
l.ogistirsAlalcriel).  Ot.H  requirement*  wrrr  larger  than  on-hoard  (llrrrnihrr  1*17.7  prrsrul  grade) 
strength  figures  (  I  allies  12.  I  I.  and  II)  l  or  thrrr  nthrr  arras  (I  oniuiandrr  llirr.  Im . 
\  dministrativ  r/Support  and  M  rdical/l’rnfrssional).  on-hoard  st  rrii^rl  It  figure*  wrrr  larger  than  <H.H 
requirement*  (Table*  II.  1.7.  and  Iti) 
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lor  lieutenant  colonel  changes.  there  would  be  an  inerease  in  the  number  of  I  III 
authorizations  for  all  six  areas.  The  percentage  of  inerease  for  lieutenant  colonels  is  particular!) 
noticeable  for  the  tommaiidcr/Miroolor.  Scienlific/F.ngineering.  and  M edieal/l’rofessional  areas. 
\  tun  lier-w  ise.  the  lirsl  three  areas  listed  in  Table  I  7  would  have  substantial  in  ceases  (i.e..  IdO.  I  12. 
27>8  eases,  respeeliv  elv  .  in  Tables  11.12.  and  Id  for  lieutenant  colonel).  For  the  last  three  areas  listed, 
the  actual  number  of  eases  w  ere  smaller  (i.e..  27.  2<>.  and  H  l.  respeeliv  elv  .  for  Tables  1  l.  17).  and  1 1>) . 
I  om paring  on-board  strength  figures  ((leeeinher  I*/ 7.)  present  grade)  to  (MiH  requirements 
rev  call'd  that  two  areas  (  \ir  Operations  and  M  edieal/l’rofessional)  had  on-board  values  larger  than 
(M.H  values  (Tables  12  and  ltd.  For  the  four  other  areas  (Tables  II.  Id.  II.  and  I7>).  (Mill 
requirements  were  larger. 

lor  changes  at  the  major  grade  lev  el.  the  percentages  of  increase  for  major  authorizations  w  on  Id 
be  quite  large  for  all  five  ol  the  areas  (i.e..  <  ommaner/l tiredor  area  excluded  since  this  grade  is  not 
included  in  \  I 'll  dti-1  grade  spread).  Number-wise  these  increases  were  particular!)  striking  lor  the 
\  ir  t  tpe  rat  tons  (  t  |  ,27>8)  and  Sc  ientific/F  ngineering  (  ♦  2.1 20)  areas  and  quite  substantial  lor  the 
I  ogislicsA)  ateriel.  \dminislrativ  e  and  M  edieal/l’rolessional  areas  (i.e..  8B(>.  7(»K.  and  d  IK  for  Tables 
II.  I  i.  and  I  <i.  respect i v  elv )  With  regard  to  on-board  ( 1  leccni her  I  *•  7 7i  present  grade)  v  ersiis  Ot.ll 
reipiiremenls.  tor  all  live  areas  (Mill  values  were  larger  (Tables  12  to  10).  Number-wise,  the 
Scienlific/F  ngineering  and  I  ogislies, At  ateriel  areas  reflected  the  largest  difference:  ti  e  .  2.280  and 
1 .2  •  d.  respeeliv  elv ) 

Vt  ihi-  combined  captain/liciitcnant  grade  level,  there  was  a  decrease  in  the  percentage  of  I  IM 
authorizations  for  each  of  the  five  areas.  The  Seientifie/F.ngineering  area  reflected  the  largest 
decrease,  representing  a  dilference  ol  2.dO(>  cases.  The  \ir  Operations  and  I  ogislicsAI  ateriel  areas 
also  reveal  a  substantial  decrease,  representing  1.108  and  8(i8  cases,  respeetivelv  ^  ilh  regard  to  on¬ 
board  v  ersu»  <  M .  II  requirements,  for  all  fiv  e  areas,  on-board  strength  figures  w  ere  larger  than  (M.H 
requirements  This  difference  was  partieularlv  noticeable  in  four  of  tile  areas  (i.e..  differences 
ranging  Iroin  l.  idll  to  d.ulK  cases) 

f'nijectiiiii  Kesulls  -  at  I  tilt/ a  boll  Fie  kls 

''nice  one  requirement  lor  K  I’H  77t-2l  we  to  project  estimates  of  grade  requirements  for  non- 
aircrew  officer  utilization  fields,  projections  and  comparisons  for  >f  utilization  fields  (2-characlcr 
\lst  •)  are  provided  in  \ppendiv  (  The  values  m  the  7>t  tables  IVppcndiv  (  I  reflected  wide 
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variation*  between  ami  within  specialties  ami  permitted  detection  of  specific  utilization  lield 
differences  which  were  not  observable  in  the  preceding  series  of  comparisons  (Tables  6  to  IT)  The 
of  tables  were  accomplished  bv  sampling  1  7°<>  (over  1  1 .000  jobs)  of  the  02.602 -job  population  ot 
non-aircrew  positions.  Fach  table  consists  of  the  OMR  job  samples  used  for  projections.  H(,>  I  SU¬ 
MS  O  l  IM.  population  values.  OMR  projected  grade  requirements,  differences  between  VI  &  O  l  IU. 
and  OOK  requirements,  and  present  on-board  distributions  (December  107!)  and  J line  |07l> 
l  niform  Officer  Record  strength  figures).  The  percentages  for  each  grade  level  of  the  totals  for  the 
lour  columns  (VK*t  O  1  Ml..  (Mill,  and  present  grade),  are  also  recorded. 

In  the  interpretation  of  these  projections,  particular  attention  should  he  directed  to  the  sample 
sizes  used  as  a  basis  for  making  OMR  estimates  of  grade  requirements.  Projections  of  grade 
requirements  for  the  total  non-aircrew  force  are  very  stable,  and  the  six  groupings  of  career  areas  also 
have  adequate  and  representative  job  samples.  VI  any  of  the  fi  t  tables  of  officer  utilization  fields  are 
based  on  adequate  AFSK-by  -grade  job  samples  to  place  considerable  confidence  in  the  stability  of 
projected  grade  estimates.  For  example,  in  the  ftl\  \  (Aircraft  Maintenance/Avionics)  field,  the 
VI  X  ()  I  Ml.  value  was  2.681  with  a  job  sample  of  60!>  across  grades  colonel  through  captain/  i  -• 

lieutenant.  However  in  some  of  the  utilization  field-by -grade  cells,  the  number  of  jobs  sampled  may  1  ( 

not  have  been  sufficient  to  assure  representativeness  and  stability  of  projected  requirements. 

Projections  made  on  insufficient  sampling  could  result  in  either  an  understatement  or  overstatement 
of  grade  requirements.  For  example,  in  0046.  Director  of  Logistics,  only  six  of  100  lieutenant  colonel 
jobs  were  sampled. 

In  evaluating  the  adequacy  (or  representativeness)  of  sample  sizes,  both  the  actual  utilizalion- 
by -grade  cell  frequencies  and  percentages  (i.e..  sample  percent  of  AlX  O  l  Ml.  values)  should  he 
considered,  with  pritnarv  emphasis  given  to  the  actual  cell  frequencies.  As  an  overall  guideline, 
projections  from  cell  frequencies  less  than  8  to  10  oases  should  be  treated  cautiously.  However,  a 
more  svslematic  procedure  was  developed,  based  on  sample  cell  frequencies  and  the  ratio  «» f  these 
samples  to  MX  <)  l  Ml.  values  (i.e..  percentages).  An  explanation  of  this  procedure  is  provided  in 
Appendix  ('..  F.acli  utilization  field-by -grade  cell  without  desired  sample  size  (according  to  this 
procedure)  has  been  identified  with  an  asterisk.  Further,  if  the  OMR  technology  were  operationally 
applied  to  determine  grade  requirements  within  a  particular  utilization  lield.  an  adequate  or  even 
1 1 M  >"n  sampling  of  jobs  in  certain  specialties  (e.g..  those  with  smaller  populations)  is  recommended. 

j 

The  most  striking  feature  of  the  tables  in  Appendix  M  is  the  widespread  variation  in  grade 
requirements  for  .").'?  of  the  of  offieer  utilization  fields.  Comparison  of  the  AKA  O  l  Ml.  versus  OMR 
slated  grade  requirements  (see  difference  column)  indicated  that  implementation  of  the  (Mill 
lechnologv  would  produce  significant  changes  in  stated  grade  requirements  based  on  job  content  and 
responsibililv  for  all  specialties.  I  u  some  instances  there  was  a  general  dow  ngrading  ol  jobs:  in  other 

instances,  there  was  a  general  upgrading  of  jobs.  There  were  also  many  varied  adjustments  or  i; 

combinations  of  changes  between  these  two  general  trends.  For  information  regarding  changes  or  i 

com  par  iso  ns  within  an  v  specific  utilization  field,  the  reader  should  examine  t  he  tables  in  A  ppendix  M  ; 

which  are  arranged  in  numerical  AFSM.  sequence  (0016  in  6<>\\).  Some  examples  are  provided 

'ilhscqucntlv .  howcv  or.  to  illustrate  the  interpretation  of  the  tables  and  to  point  out  that  the  gross  (or 

grouped)  values  in  Fables  II  through  16  which  were  averaged  across  certain  AFSM*  do  not 

neeessarilv  reveal  the  wide  variations  which  mav  appear  within  grade  levels  lor  a  particular 

-peciallv  I  s-entiallv  .  the  finding*  from  the  table*  in  Appendix  M  (w it h  appropriate  eaulions)  would 

he  useful  with  regard  to  actions  or  recoin  m  clidal  ion*  taken  bv  A  ir  I  oree  management  to  make  grade  , 

adjustments  within  ollicer  iilili/aliou  field*.  I 
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As  an  example,  in  file  ( '.om inandrr/ 1  )irector  area  (Table  1 1).  there  was  a  downgrading  of  21 1  l  Dl, 
colonel  authorizations.  As  shown  in  Appendix  C.  (XiR  calls  for  an  inerease  of  27  colonel  authorizations  in 
the  Organization  Commander  (002t>)  specialty.  For  the  remaining  specialties  in  the  Conunander/Dirootor 
area,  the  percentage  of  ll)L  colonel  authorization  decreases  varied  from  approximately  7%  (00W).  Air 
Commander.  —  15/20*1  =  7.18%)  to  55%  (0056.  Comptroller.  —  57/l()i  =  54.58%). 

VI  ith  regard  to  M&O  l  Dl.  versus  OCR  difference  at  the  lieutenant  colonel  grade  level 
(  Appendix  C).  there  were  55  utilization  fields  where  OCR  requirements  were  greater  than  l  1)1. 
authorizations.  17  fields  with  OCR  requirements  less  than  11)1.  authorizations,  and  2  fields  where 
l  Dl.  and  OCR  requirements  were  the  same.  Of  the  17  fields  where  OCR  application  would 
represent  a  decrease  in  l  Dl.  authorizations  for  lieutenant  colonel,  the  losses  were  distributed  across 
utilization  fields  in  ail  of  the  six  career  categories  (i.e..  two  fields  in  C  o  in  in  a  n  d  er/D  i  root  o  r .  two  in  Air 
Operations,  three  in  S&  K.  three  in  l.ogisticsAl ateriel.  four  in  Administrative,  and  three  in  Medical/ 
Professional).  However,  within  categories  where  there  were  fields  with  decreases,  there  were  other 
fields  with  increases  (e.g..  0f\\.  Supply  Management  versus  <>6\\.  Logistics  Plans,  see  Table  1  1 
and  Appendix  ('.). 

examination  of  Appendix  C.  reveals  that  the  Medical/Professional  area  has  a  number  of 
problems  which  are  not  detectable  in  Table  16.  Four  utilization  fields  selected  as  examples  are  Judge 
Advocate  (88\ X ).  Chaplain  (8*)\\).  Health  Services  Administrator  (*)0XX).  and  Nurse  (*>7\\). 

The  Judge  Advocate  field  (88\\)  OCR  requirements  exceeded  l  Dl.  authorizations  for  the 
major,  lieutenant  colonel,  and  colonel  grade  levels.  For  these  grade  levels,  the  on-hoard  strength 
figures  (both  December  1*175  and  June  1*>76  LOR)  were  less  than  the  l  Dl  authorizations 
(  Appendix  C).  Fvon  if  the  OCR  grade  requirements  for  major  were  reduced  by  making  adjustments 
to  the  conversion  table  (Table  5)  as  previously  described,  difficulty  would  still  be  encountered  in 
filling  major  through  colonel  requirements  in  the  88\\  utilization  field  unless  the  retention  of 
junior  officers  is  improved. 

The  December  1*175  (also  June  1*176)  COR  indicated  that  about  12%  of  the  Chaplain  (8‘1\\) 
utilization  held  was  graded  as  lieutenant  colonels  or  colonels  (  Appendix  C).  The  l  Dl.  called  for 
about  25%  in  these  grades,  and  the  OCR  reduced  this  value  to  approximately  1 7%  .  In  terms  of  <  1C R 
requirements,  the  Chaplain  field  is  overgraded  at  the  upper  levels.  However,  it  should  be  recognized 
that  there  may  he  grounds  for  supporting  the  present  grade  structure  on  bases  other  than  the  (Kill 
definition  of  grade. 

The  Health  Services  Administrator  (*10XX)  field  has  a  rather  unique  feature.  The  I  Dl.  calls  for 
about  the  same  number  of  majors  as  lieutenant  colonels.  The  OCR  also  calls  for  about  the  same 
number  of  majors  and  lieutenant  colonels  (214  vs.  210).  and  for  lieutenant  colonels,  this  is  about 
twice  the  number  on-board  (106).  This  suggests  that  the  grade  structure  in  this  utilization  field 
merits  investigation  of  the  nearlv  equal  requirements  at  these  two  grade  levels. 

For  the  \  ursc  (*)7\  \  )  field,  the  (Mill  requirements  call  for  a  dow  n -grading  of  field  grade  nurse 
positions  compared  to  those  authorized  hv  (he  I  III..  Vdditiouallv .  the  on-board  population  II  OR  1 
is  considerably  overgraded  for  either  set  of  requirements.  As  in  other  utilization  fields  however  (e  g.. 
Chaplain),  there  mav  he  other  reasons  for  supporting  the  nurse  grade  structure  on  bases  other  than 
the  (ICR  definition  of  grade  requirements. 


MIL  SI  MMAKY  \N|>  CONCH  SIONS 


I  his  st uih  had  Iwo  major  purposes.  I  hi*  first  obj**rliv<*  was  iht*  dr\ rlopmrnl  and  lar^r-M-alr 
firltl -testing  of  a  reliable  and  s\ stematie  method  1> %  which  M  l\  IV  could  determine  the  appropriate 
ildt*  levels  (lieutenant  to  colonel)  oi  non-aircrew  officer  positions  (excludes  line  pilots.  nav  igators. 
pit V  sieiaus  anil  dentists).  I  he  second  objective  w  as  to  applv  the  tcchnologv  to  an  ollieer  joh  sain  pie  o  1 
>n  1 1  i<- it'll  t  size  to  estimate  the  grade  requirements  for  the  total  non-aircrew  officer  force  and  various 
oflieer  utilization  fields,  it  the  technology  was  implemented  operationailv . 

The  basic  technologv  used  in  this  study  has  been  under  development  and  refinement  at  various 
periods  for  15  vears.  and  represents  one  of  the  most  comprehensive  and  carefully  researched  joh 
evaluation  svstems  in  existence.  The  large-scale  field  test  and  projections  for  the  present  effort  represent 
modification  and  extension  of  this  research. 

lo  test  the  technology  and  make  projections  of  non-aircrew  grade  requirements,  independent 
ev  al  nation  teams  from  122  Vir  I'oree-w  ide  M  KTs  (‘>50  qualified  raters)  collected  and  cv  a  Inn  led  over 
11.000  ollieer  joh  descriptions  under  detailed  instructions  which  guaranteed  the  scientific  and 
technical  integrity  ol  the  data.  In  addition,  ratings  were  obtained  from  these  teams  on  a  sample  of 
jobs  (1.725)  which  had  previously  been  evaluated  by  a  ll(,>  l  SAT  I’olicv  Hoard.  \  varielv  of 
analyses  were  conducted  to  determine  the  reliahilitv  and  aecuracv  of  the  Vi  KT  application  (i.e.. 
ratings),  and  tile  stability  ol  the  data  on  the  11.000  jobs  for  making  projections  lo  the  total  non- 
aircrew  loree.  \n  integral  part  ol  the  analyses  was  the  development  of  an  inleger-werghled  eight- 
variable  poliev  equation  and  a  grade  conversion  table,  which  represent  the  svslematie  method  for 
M  IT  to  use  in  determining  non-aircrew  officer  grade  requirements. 

I  he  method  dev  eloped  to  establish  ollieer  grade  requirements  is  like  a  v  aid  slick,  except,  instead 
ol  measuringleetorinehes.it  measures  the  amount  of  job  content  and  rcspoiisibilitv  associated  with 
ollieer  positions.  Vs  the  level  o!  content  and  responsibility  changes,  so  does  the  appropriate  grade 
level  lor  a  job.  basic  ingredients  ol  (his  y  ardstiek  consist  ol  eight  variables  in  an  equation  applied  to 
data  collected  by  and  front  manpower  and  management  engineering  personnel,  The  essential 
components  and  steps  involved  in  the  application  are:  lirsl.  job  descriptions  are  completed  In 
officers  using  a  standard  form  that  provides  a  listing  of  duties  and  tasks  performed  and  organizational 
inlormation  regarding  the  position.  The  descriptions  are  then  ev  aluated  In  the  officer's  siiperv  isor. 
Next.  M  f.  I  judges  evaluate  each  ollieer  joh  deseripl ion  and  rate  I licsc  descriptions  in  terms  ol  live 
joh  factor  benchmark  scales.  These  job  factors,  together  with  the  other  variables,  are  a-  follows. 

Job  f  actors: 

1.  Special  Training  and  VI  orb  f. xperienee 

2.  (  ommuniealion  Skills 

1.  Judgment  and  Decision  Making 

1.  I’lanuing 

5.  Management 

Organizational  I  n  for  in  at  ion : 

(i.  l  evel  ol  Organization  ill  W  Inch  Job  Occurs 

7,  l.evel  of  Job  Vi  it  hi  n  Organization 

Supervisurv  Vppraisal: 

d.  Superv  isor’s  Judgment  of  V ppropriate  ( i rade  for  Job. 


l  sing  the  preceding  information  about  a  particular  position  in  the  eight-variable  equation,  a 
numerical  score  (predicted  composite  score)  can  be  computed  to  place  a  job  at  an  appropriate  level  of  job 
content  and  responsibility  compared  to  other  Air  Force  officer  jobs.  A  conversion  table  is  then  used  to 
translate  the  composite  score  to  (he  appropriate  grade  level,  lieutenant  through  colonel.  Kssentiailv.  the 
OCR  equation  assigns  jobs  in  the  correct  order  of  merited  grade,  and  the  conversion  table  assigns  the  right 
number  of  jobs  to  each  grade  level,  based  on  job  content  and  responsibility. 

In  obtaining  data,  the  benchmark  lactors  used  by  \1  FTs  consisted  ol  a  ‘l-poinl  scale  (•)  =high  to 
I  low),  with  each  point  defined  in  terms  of  appropriate  job  title  representing  that  level.  I  best- 
benchmark  scales  permit  raters  to  "nest  "  their  judgments  according  to  the  amount  ol  the  lactors 
required  in  individual  officer  jobs.  The  organization  level  variables  and  supervisor’s  judgment  ol 
appropriate  grade  are  extracted  from  the  incumbents  job  description,  from  live  to  seven  M  I.  I 
members  provided  benchmark  factor  ratings  on  each  position  description  evaluated. 

Vnalvses  revealed  that  Mi  l'  raters  could  ver-  aeeuratelv  and  efficiently  apply  the  (ICR 
teehnologv.  For  a  subsample  (l.72.>)  ol  ollieer  positions,  using  M  f.  I  ratings  in  the  eight-variable 
policy  equation.  It  was  possible  to  estimate  with  considerable  assurance  the  results  which  would  be 
obtained  if  M  FT- were  to  applv  the  (ICR  teehnologv  to  all  \ ir  Force  non-aircrew  ollieer  positions 
((>2.b(l2).  I  he  sampling  base  (over  II. (1(1(1  jobs)  was  sufficient  to  provide  projections  lor  the  total 
non-aircrew  force  and  v  arious  officer  utilization  fields. 

Comparison  ol  OCR  projected  grade  requirements  with  currently  authorized  (MstO  I  HI.) 
grade  levels  revealed  that  the  total  non-aircrew  force  has  fewer  authorized  lield-grade  ollieer 
positions  than  indicated  hv  the  (ICR  technology.  Vi  bile  results  indicated  lower  OCR  colonel 
requirements  than  I  HI  authorizations,  there  was  an  increase  in  tin-  OCR  requirements  lor 
lieutenant  colonels.  The  lieutenant  colonel  increase  more  than  balanced  the  colonel  reductions  (i.e.. 
decrease  of  Kid  colonels  and  increase  ol  <i!2  lieutenant  colonels),  further,  the  l  HI.  versus  OCR 
difference  was  particularlv  striking  at  the  major  grade  level,  where  OCR  recommended  a  very 
substantial  increase  in  grade  requirements.  Converselv.  at  the  combined  eaptaiu/lieutenanl  grade 
level.  OCR  reflected  a  v  erv  large  reduction  in  grade  requirements  as  compared  to  I  HI. 
authorizations. 

I  out  pari  so  us  of  on-board.  I  HI.  and  OC  R  requirements  revealed  that  there  w  ere  l.dlKi  colonels 
in  I  he  aeliv  e  dill  v  force  ( Decent  her  HIT.")  —  l  OR  )  which  w  as  f.'f.’f  less  than  called  lor  by  the  l  01.  but 
ill  more  than  OCR.  These  results  suggest  that  grade  requirements  based  on  job  content  and 
i  e-poii'ilnlit  v  levels  would  accommodate  nearly  all  of  the  on-board  colonels. 

(  ompari-on-  of  OCR  versus  011-lmard  (l  OR)  also  suggest  a  possible  additional  usage  ol  the 
III .  |(  teehnologv .  Composite  scores  deriv  ed  for  positions  could  be  used  lor  im  prov  ed  d  i  Keren  tiat  ion 
in  t  he  assignment  process  at  all  grade  levels.  For  example.  OCR  grade  com  posit  e  score-  could  be  used 
In  identilv  higher-level  lieutenant  colonel  positions  lor  colonel  selectees. 

\-  noted.  0(.|!  in  healed  a  large  requirement  for  more  majors  and  lower  captains/lieutenanis 
l  ban  called  lor  bv  I  lie  I  HI .  \\  bile  OC  R  —staled  require  incuts  for  major  positions  may  be  correct  in 
1 1- nil  -  ol  I  lie  content  and  rc-pon-ibili!  ie-  associated  with  these  positions,  it  may  not  be  possible  lor  the 
\ir  I  one  to  produce  llii-  main  majors  from  the  staled  eaptain/lieutenan!  base.  Mlhough  separate 
breakouts  are  not  prov  iiled  lor  captain-  and  lioulon  ints.  the  policy  equation  reflected  a  requirement 
lor  consider. iblv  more  captain-  than  lieutenants,  which  would  be  even  more  unreasonable  to 
implement 

fin-  preceding  problem  I-  generated  bv  the  lad  that  the  \  i  r  force  Folicv  Hoard  recognized  v  erv 
lew  nun-aircrew  position-  a-  being  appropriated  Idled  bv  lieutenants:  vet  the  Vir  furee  i-  a  closed 
-v  -  loin .  and  w  u  li  lew  exceptions  (eg.,  pli  v  sjciau-)  does  not  hire  captains  direct  I  v  I  rum  the  civilian 


:u 


M‘rinr.  I  or  I  In-  rc.i-un.  ii  in  d\  !>«■  nr«r— ai\  I  *  *  idrnlih  a  ccriiim  |»ro|m  rl  it » n  >»f  (In-  In  *  n-l»v  cl  (M*|{ 

<  apiain  |»o-iiioii-  ami  dcrl.nv  llx-in  In  hr  liruiriiant  |io-ilioii-  on  ihr  l  Dl  .  siinil.irl\ .  ii  nia\  hr 
nrr«'— ar\  lo  declare  «i  -mall  pro|inrlion  ol  ihr  Utw  rr-lr\ rl  (M,|{  major  to  hr  captain 

position*  on  (hr  l  IM  .  Surli  aclinU-  e— cntialU  rcilrct  ihr  recognition  ol  ihr  need  lo  link  rarrrr 
pro»»rr->ion  program  -  \\  illi  joh  rr<|iiirr niriii -  in  order  In  pro v ide  reasonable  promo  I ion  pom (-.  Sim** 
(hr  l)h|{  (‘(pialioil  v  irhl-  a  ronhmioii-  (li-lrihulion  of  composite  -rorr-  rrflrrlm^  (hr  rr-poii-tlii III  \ 

I < ’ '  •* I  nl  po-ilitm".  llirrr  is  llr\ihilt!\  in  delimit}!  riiilinj!  point-  for  diilerenl  jrradr  level-. 
I  (m-njuriilh  .  dev  rlnpmml  ol  a  min  rr-ion  tahlr  to  pro\  itlr  an  approprialr  <i  i-t  nhul  ion  ol  jjrade-  a  I 
I  hr  f  «>Mrr  lt‘\  rU.  ;(>  >|M*ri  1  iimI  Ii\  \  i r  I'orrr  m  a  nugrm  r  lit .  appear?-  dc-i  rahlc.  I’ hr  development  o |  «ur h 
,i  rint\ iT>ion  tahlr.  however.  miiiiIiI  require  a  rniiriirrml  exam  mat  mu  ol  it-  imparl  on  grade 
requirement^  in  \ariou-  ollirrr  ulili/ation  field-. 

I  oni pari>on>  ol  I  01.  \er-u>  Ohll  -lated  requirement-  miliralril  that  unplrinrniatioii  ol  tltr 
IX.K  ifeluiolngx  uonlil  pruduee  -ignilieant  i  lunge-  in  -lated  grade  requirement-  lor  mam  oUti  rr 
ill  ill/ill  iotl  I  irlil  -.  In  >o  m  r  ill -I  a  nee-  llirrr  m  a-  a  or  nrral  duw  iigrading  ot  join:  in  o  I  lire  in-laiiee-  |  here 
wa-  general  upgrading  ol  join.  These  I i mli -ugge-t  that  ihr  (M,|i  leeliiioiogx  max  hr  parliriil.irlx 
n-eliil  xx  i  Ol  regard  lo  aelioii-  lakrn  h\  \ir  loree  Management  to  make  grade  adjii-liiieiil-  xxilhin 
ollirrr  iilih/alion  lirlil-. 

For  (hr  present  study,  the  question  may  arise  whether  a  new  criterion  hoard  should  have  been 
established  to  express  grade  policy  as  of  OTt).  There  are  several  reasons  for  using  the  1'ltil  Policy  Board's 
statement  of  grade  requirements  for  the  criterion  job  sample  (1.725  jobs)  rather  than  attempting  lo  obtain 
another  policy  statement.  The  initial  OCR  project  was  one  of  the  largest  and  most  carefullv  executed  joh 
evalution  studies  ever  accomplished,  in  or  out  of  the  military  service.  Nvimerxxus  analyses  were  conducted 
before  the  Policy  Board  judgments  were  accepted  as  a  criterion,  and  results  demonstrated  that  hoard 
member  ratings  were  reliable,  reasonable,  and  unbiased.  Kach  step  in  the  project  was  fullv  documented, 
and  all  data  or  analyses  involved  in  the  effort  are  still  available  for  inspection.  Similar  findings  for  the 
initial  poliry  board  would  appear  difficult  to  reproduce  in  today’s  environment. 

Additionally,  while  new  types  of  officer  positions  have  been  introduced  since  I 'Mil.  there  is  reason  to 
believe  that  the  "grade  definers"  in  the  equation  developed  are  as  valid  for  today's  jobs  as  jobs  existing 
previously.  During  the  original  study,  tests  were  conducted  which  revealed  that  grade  had  a  universal 
meaning  and  that  the  same  factors  and  weights  were  applicable  to  all  classes  or  types  of  jobs.  Therefore, 
the  same  equation  should  be  valid  for  any  new  tvpes  of  jobs.  Finally,  attaching  grade  requirements  to  a 
constant  standard  (i.e..  the  same  equation  and  policy  board)  would  tend  to  prevent  anx  unjustified  "grade 
creep"  over  time.  Assuming  objective  application  of  the  benchmark  scales,  anx  increases  in  stated  grade 
requirements  would  he  associated  with  actual  increase  in  job  content  and  responsibility  levels. 


I\.  KH  OMMIMtVriONS 

If  Air  Force  management  wishes  to  implement  a  system  for  determining  non-aircrew  officer  grade 
requirements  in  terms  of  job  content  and  responsibility,  tile  (Kill  technology  is  recommended  for 
consideration.  However,  this  recommendation  is  made  with  emphasis  on  the  need  lo  link  career 
progression  programs  with  joh  requirements  in  order  to  provide  reasonable  promotion  points.  The  present 
study  did  not  attempt  to  resolve  an  officer  grade  structure  lo  support  orderly  career  progression  in  various 
specialties,  although  certain  suggestions  regarding  adjustments  lo  a  conversion  table  are  given  below.  \n 
optimal  final  officer  grade  determination  system  would  likely  represent  some  compromise  between  the 
OCR  technology  and  certain  modifications  to  support  orderly  career  progression  as  well  as  allow  for  some 
shifts  in  requirements  between  career  fields,  \dditionallx .  some  changes  in  the  present  technology  for 
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operational  application  should  be  considered,  as  in  multi-point  position  classification  involving  similar 
jobs  in  different  locations  or  organizations.  For  example,  some  changes  in  the  procedure  used  to  obtain  job 
descriptions  for  officer  positions  may  be  necessary. 


The  difference  between  OGR  and  l  1)1.  grade  requirements  was  partieularlv  striking  at  the  major 
grade  level  where  OGR  indicated  a  substantial  increase  in  requirements.  While  the  OGR  stated 
requirements  for  major  positions  seem  defensible  in  terms  of  content  and  responsibility,  it  may  not  he 
possible  for  the  Air  Force  to  product-  this  many  majors  from  the  stated  captain/lieutenant  base.  Therefore, 
it  may  he  necessary  to  identify  a  certain  proportion  of  the  lower-level  OGR  major  positions  to  he  captains 
on  the  l  01..  and  some  lower-level  captain  positions  as  l  1)1,  lieutenant  positions.  Such  an  interpretation 
recognizes  the  need  to  link  career  progression  with  job  requirements.  Since  the  OGR  equation  yields  a 
continuous  distribution  of  composite  scores  reflecting  different  levels  of  responsibility  for  officer 
positions,  it  provides  certain  flexibility  in  defining  cutting  points  for  different  grade  levels.  Consequently, 
development  of  a  conversion  table  to  provide  an  appropriate  distribution  of  grades  at  the  lower  levels  is 
recommended,  as  specified  by  Air  Force  management.  The  development  of  an  adjusted  conversion  table, 
however,  would  also  require  a  concurrent  examination  of  its  impact  on  various  officer  utilization  fields. 

The  OGR  projections  to  the  non-aircrew  force  indicated  significant  changes  in  grade  requirements 
for  many  officer  utilization  fields.  In  some  fields  there  would  be  a  general  upgrading  of  jobs  and  in  others 
a  general  downgrading  of  jobs.  The  OGR  technology  should  be  particularly  useful  with  regard  to 
recommendations  or  actions  by  Air  Force  management  to  make  grade  adjustments  within  utilization 
fields.  Projections  in  the  present  study  could  be  used  as  "checks  and  balances"  in  the  examination  of 
grade  structure  adjustments  made  in  various  officer  utilization  fields,  based  on  reasons  or  justification 
other  than  the  OGR  definition  of  grade  requirements. 

The  findings  suggested  that  grade  requirements  based  on  job  content  and  responsibility  could 
accommodate  nearly  all  on-board  (TOR)  colonels. 

Comparisons  of  OGR  versus  on-board  (TOR)  requirements  also  suggested  a  possible  additional  usage 
of  the  technology  .  Composite  scores  derived  for  positions  could  be  used  for  improved  differentiation  (of 
positions)  in  the  assignment  process  for  all  grade  levels.  For  example.  OGR  grade  composite  scores  could 
be  used  to  identify  higher  level  lieutenant  colonel  positions  which  can  service  as  training  positions  for 
colonel  selectees. 


Itl  I  I  HIM  I  s 
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APPENDIX  A :  JOB  DESCRIPTION  FORM  FOR  1976  MET  OCR  PROJECT 


AIR  FORCE  OFFICER  POSITION  DESCRIPTION 
INSTRUCTIONS 

This  survey  is  directed  by  Hq  USAF  to  identity  and  describe  the  won  perform  :  •,  ,*.><■  r  ,  ■ 

The  Air  Force  needs  precise  information  about  the  duties,  tasks,  and  requirements  of  o“icer  ini"  m  •rc!i-  to  maintain 
the  classification  structure,  to  make  appropriate  grade  allocations,  to  aefme  incumbent  qualifii  ao;"’s  t,nd  t>  a,. id* 
other  manpower  and  personnel  actions.  Participation  in  this  survey  gives  y.n,  an  cm  ortun.tv  r  pro.  .le  a*, 
information  about  your  job  in  support  of  improved  Air  Force  management. 

You  are  requested  to  complete  the  survey  according  to  trie  following  instructions 

1.  ASSIGNMENT  INFORMATION  (Page  4)  Fill  in  the  required  data  c>r  check  the  one  p'.'v  in  earn  qicv  >  trial 
applies  to  you. 

2.  JOB  DESCRIPTION  (Pages  2  and  3)  On  these  pages  pruvid-*  typewritten*  in*r*r-'.atiO‘;  -.vhi.-n  accurately 
and  comprehensively  describes  your  job. 

a.  I  n  the  JOB  NAME  OR  TIT  LE  block,  rreero  a  name  or  title  which  is  descriptive  vour  lot . 

b.  In  the  JOB  CONT E  XT  block,  locate  youi  job  within  the  organizational  structure. 

Examples  (II  THIS  JOB  IS  IN  THE  HEAVY  EQUIPMENT  BRANCH  DIRECTLY  UNDFR 
THE  BASE  MOTOR  POOL  COMMANDER,  WHO  REPORTS  TO  THE  M  &  S 
GROUP  COMMANDER, 

(2)  THIS  JOB  IS  IN  THE  TARGETS  SECTION  OF  THE  OPERATIONS 
PLANNING  BRANCH  OF  WING  HQ. 

c.  In  the  blocks  under  DUTIES  AND  TASKS,  list  statements  that  describe  your  job.  Consider  significant 
work  activities  such  as  those  involved  in  commanding,  planning,  organizing,  directing,  monitoring, 
coordinating,  reviewing,  inspecting,  evaluating,  supervising,  and  operating.  Use  as  many  blocks  as  you 
consider  necessary.  The  statements  you  provide  should  clearly  define  yuur  nip. 

Example  Duty  A  DIRECTING  MATERIEL  CONTROL  FUNCTIONS 
TASKS  (1)  ASSIGN  PRIORITIES  TO  REQUISITIONS 

(2)  COORDINATE  REQUIREMENTS  FOR  MOBILITY  DEPLOYMENT 

(3)  MONITOR  SUPPLY  BUDGET 

(4)  PROCESS  REQUESTS  FOR  LOCAL  MANUFACTURF.  OF  ITEMS 

(5)  REQUISITION  TIME  CHANGE  ITEMS 

First,  list  all  the  maior  duties  you  perform,  then  go  back  and  list  the  approt  nate  tas»  $  under  cat.1i 
duty.  Describ*  vour  normal  |ob.  Omit  temporary  variations  in  your  wort,  which  are  not  part  of  your 
regular  assignment.  Ignore  additional  duties  unless  they  constitute  a  significant  part  or  \  our  mb. 

d.  In  the  JOB  Rf.OUl REME NTS  block,  enter  additional  statements  that  describe  any  unusual 
requirements  of  your  iob  for  the  factors  below. 


COMMUNICATION  SKILLS 
INTERPERSONAL  SKILLS 
WORKING  CONDITIONS 
FORMAL  EDUCATION 


ORIGINALITY,  INGENUITY,  8.  CREATIVENESS  MANAGEMENT 

SPECIAL  TRAINING  &  WORK  EXPERIENCE  PLANNING 

JUDGMENT  &  DECISION  MAKING  RISK 


L 


Example*  (1)  WORKING  CONDITIONS  JOB  REOUIRFS  APPROXIMATE!  Y 
120  DAYS  TDY  ANNUALLY. 

(21  SPECIAL  TRAINING  8*  WORK  EXPERIENCE  JOR  RrOUIRFS  A  Tan  AY  A  F 
COURSE  IN  SPECIAL  WEAPONS  DELIVERY 

e.  In  the  JOB  SUMMARY  Block,  write  a  three-or  four-sentence  summary  d»r»  'iption  ,  *  \  .»  *  mb 

t.  After  y  ,  ,  ■  av.  •  li;  let*«1  pages  2  • .  and  4  ■>  :•  ••  |.  ..  (  .  -  -  .  ,t  •  •  i>  .. 

L'r :•  yix.r  s  i;  "rviso’. 

NOT l  Supervisor  will  review  all  cranes,  c  heck  a  box  to  indicate  his  judgment  of  the  most  appmprute  snide  level  tor 
this  iob.  sign  the  form,  and  return  to  \s<ur  Management  Engineering  Organization. 

•|f  tvpirw)  wrvicr  it  not  available,  information  iboulri  be  clearly  printed  by  hand 
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JOB  REQUIREMENTS 


JOB  SUMMARY 
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AF  OFFICCFt  POSITION  DESCRIPTION 


P»^  -t 


JOB  DESCRIPTION  NUMBER  TO  BE  ASSIGNEO  BY  ME  T 


|l  AST  NAME 


FIRST  NAME 


[ORGAN  12  AT  ION 


f  BASE  OR  INSTALL  ATIC 


[SOCIAL  SECURITY  ACCOUNT  NUMBER 


YOUR  PRIMARY  AfSC 


Numfaw  Q.  10  19' 


Number 

(23  26) 


UOL  AUTHORIZED  YOUR  PRESENT  GRADE  OF  YOUR  YOU R  DUTY  AFSC 


MADE  FOR  YOUR 

POSITION 


Col 

!  h 

c  J 

L/C 

□  < 

Capt 

i  3 

Lt 

w/o 

l;  o 

IMMEDIATE 

SUPERVISOR 


LEVEL  OF  YOUR 
ORGANIZATION 

(check  on«) 

(45) 

DOD,  Hq  USAF  fl  9 
Mq  Ma|  Air  Corod  [  ]  8 

Numbered  A F  n 

(or  Equiv)  ^  J  7 

Air  Oivenn  r  — i  g 

(or  Equiv)  ‘  > 

Wing  (or  Equiv)  [_]  5 

Group  (or  Equiv)  [_J  < 

Squadron  r-j 

(or  Equiv)  J  J 

Detachment  ' 

(or  Equiv)  ^ 


[COMPLETED  BY 


REVIEWED  BY 


Signature  of  Immediate  Supervisor 


Number 

(32  36) 


TOTAL  MONTHS  IN 
YOUR  DUTY  AFSC 

_  ... 

l  _ Lj 

1)7  .19) 

TOTAL  MONTHS 
ACTIVE  FEDERAL 

MILITARY  SERVICE 

J _ i.  J 

(40  42) 

SEX 

(check  one) 

n  □ 

M  F 

1  2  (4.1  I 

LEVEL  OF  YOUR 
JOB  WITHIN 
YOUR  ORGANIZATION 

tehee*  one) 

(46) 

Command  > 

Element  v  .  7 

Directorate.  Dept,  j— g 

OMVjl  (or  Equiv)  * 

Division  .  — *  5 

(or  Equiv)  j 

(er  E<yuhr)  * 

Section  ?  3 

ten  Equiv)  1  J 

Unrt  (or  iquiv) 


HIGHEST  LEVEL 
OF  YOUR 
EDUCATION 

(..neck  only  one) 
(47) 

Doctoral  Degree  £ 

Meet aCi  Degree  [_]8 

Some  Post  —  n 

Gred  Work  -  J ' 

Bachelor's  Degree  t  ,  c 

3  Y  ears  College  5! 

2  Yean  College  l,]]4 

1  Yeer  College  (  ]: 

H*h  School  Gred  'J2  : 

Non  High  ] 

School  Grad  '--j 


Duty  ►’hone 


OF  STUDY 

i.  r  eck  only  one) 
(48) 


Othei  (Specify) 
Military  Science 
Social  Science 

Medical,  Legal 

Biamaas. 

Management 

Engineering 

Arts.  Human ttree 

Physical  Science 

E  do  cat  on 


svwRi  is  or  anrx  <m 


MAJOR 

AIR  1 

COMMAND  I 

44 

AAC 

□  * 

USA  FA 

LI]  8 

ADC 

1  ]  C 

USAFE 

□  D 

afafc 

[_]  e 

ALC 

r;  f 

AFSC 

:i  h 

A  RPC 

..]  « 

ATC 

;  j 

AU 

USAFSO 

:  i  l 

AFRES 

n  m 

Hq  USAF  □  N  1 

AFDAA 

□  o 

J  Hq  Comd  [j  P  1 

mac 

n  q 

PACAF 

kD  R 

SAC 

□  s 

tac 

:i  T 

USAFSS 

□  u 

AFCS 

□  y 

Other 

i]  r 

|  Specify 

SUPERVISORS 

JUDGMENT 

OF  MOST 

APPROPRIATE 

GRADE  FOR 

THIS  JOB 

(49) 

—  Gen 

□  ^ 

Col 

□  6 

L/C 

m  Mq 

n  5 

■'  ]  4 

Capt 

□  3 

Lt 

U  7 

*  1975  flpn  I  70S*  M  87-1  .Vt‘»  I  r>3 

M 


AF  OFFICFR  POSITION  1)1  St  HIP1  l < 


I  /’/’/•  \l)l\  H  h  I  \  K  JOB  K\  \1  I  \TU»N  FXC.TOK  HUNCH  M  \HK 
SCM.KS  IN  I’OI  it  )  KOI  \TION 


FACTOR  2:  SPECIAL  TRAINING  ANO  WORK  EXPERIENCE:  The  extent  to  which  the  job  requites 
knowledges  and  skills  which  must  be  acquired  through  special  training  courses  or  on-the-job  experience 
Disregard  general  courses  given  by  Squadron  Officer  School,  Command  and  Staff  College,  or  War  College 

LEVEL  9 

Chief  ,  Contract  Pricing  Branch,  Hq  USAF 

Chief,  Military  Justice  Division,  Ait  Div 

Space  Vehicle  Research  Officer,  Hq  AF  Special  Weapons  Center 

LEVEL  8 

Director.  Reconnaissance  k  Electronic  Warfare  Operations,  Major  Air  Command 
Mmuteman  Trajectory  Engineer.  Aerospace  Reconnaissance  Technical  Wg 
Chief,  Missile/Nuclear  Safety  Division.  Technical  Training  Center 

LEVEL  7 

Missile  Combat  Crew  Commander,  Strategic  Missile  Sq 
Chief,  Target  Intelligence  Branch,  Strategic  Reconnaissance  Wg 
Chief.  Maintenance  Operations  Div,  Aerospace  Test  Cp 

LEVEL  6 

Chief,  Consolidated  Base  Personnel  Office,  BombWg 

Hying  Safety  Officer,  Hq  Tactical  Fighter  Wg 

Reconnaissance  Aircraft  Commander,  Strategic  Reconnaissance  Sq 

LEVEL  5 

Co-pilot  B-52.  Bomb  Sq 
Pilot,  Military  Airlift  Sq 

Radar  Evaluation  Officer,  Hq  Major  Air  Command  (Overseas) 

LEVEL  4 

Chief.  Audio-Visual  Center,  Numbered  Air  Force 
Electronic  Warfare  Officer  B-52.  Bomb  Sq 
Education  Training  Officer,  Major  Air  Command 

LEVEL  3 

Crypto  Operations  Officer,  Communications  Cp  (Overseas) 

Avionics  Officer,  Consolidated  Aircraft  Maintenance  Sq 
Flight  Line  Maintenance  Officer.  Organizational  Maintenance  Sq 

LEVEL  2 

Photographic  Equipment  Maintenance  Officer,  Avionics  Maintenance  Sq 
Chief,  Pay  &  Travel  Branch,  Combat  Support  Gp 
Photographic  Officer.  Technical  Reconnaissance  Sq 

LEVEL  1 

Base  Housing  Officer,  Combat  Support  Gp 
Special  Service  Officer,  Fighter  Gp 
Transportation  Officer,  Instrumentation  Sq 

r. 


T\.  *  *  ;  »***>♦ 


FACTOR  5:  COMMUNICATION  SKILLS:  The  extent  to  which  the  job  requires  skill  in  oral  and 
written  communication.  Consider  the  complexity  and  variety  of  information  communicated  as  well 
as  the  level  of  the  individuals  and  agencies  involved. 

LEVEL  9 

Director  of  Information,  Hq  Major  Ait  Command 
Political  Military  Affairs  Officer,  Hq  USAF 
Secretary  of  the  Air  Staff,  Hq  USAF 

LEVEL  8 

Chief  of  Logistics  Division,  Hq  Numbered  Air  Force 
Astronautical  Engineer,  Hq  Space  A  Missile  Systems  Org 
OS1  District  Commander,  Hq  District  OS1 

LEVEL  7 

Base  Civil  Engineer,  Air  Base  Gp 

Human  Performance  Engineer,  Electronic  Systems  Div 

Comptroller,  Air  Base  Wg 

LEVEL  6 

Aviation  Physiologist,  Inspector  General  Gp 
Chemical  Engineer,  AF  Aero  Propulsion  Lab 
Administrative  Officer,  Electronics  Installation  Gp 

LEVEL  5 

Officer  Selection  Officer,  Det,  USAF  Recruiting  Gp 

Deputy  Commander,  Strategic  Missile  Sq 

Chief,  Sensors  Section,  AF  Special  Weapons  Center 

LEVEL  4 

Construction  Engineer,  Civil  Engineering  Sq  (Overseas) 

Squadron  Operations  Officer,  Combat  Crew  Training  Sq 
Accounting  A  Finance  Officer,  Fighter  Gp 

LEVEL  3 

Commercial  Transportation  Officer,  Materiel  Sq 
Avionics  Officer,  Aircraft  Control  A  Warning  Wg 
Missile  Mainicnance  Control  Officer,  Strategic  Missile  Sq 

LEVEL  2 

Fighter  Interceptor  Pilot,  Fighter  Intercetor  Sq 

Strategic  Missile  Complex  Maintenance  Officer,  Strategic  Missile  Sq 

Electronic  Warfare  Officer,  Tactical  Reconnaissance  Sq 

LEVEL  t 

Co  pilot.  Air  Refueling  Sq 
Naviptor.  Bomb  Sq 

Helicopter  Pilot,  Aerospace  Rescue  &  Recovery  Sq 


FACTOR  7:  JUDGMENT  AND  DECISION  MAKING:  The  importance  and  independence  of  judgments 
and  decisions  required  by  the  job.  Consider  the  nature,  variety,  and  possible  impact  of  decisions. 

The  less  well  defined  the  guidance  for  decisions,  the  higher  should  be  the  rating;  while  the  more 
specific  and  detailed  the  guidance,  the  lower  should  be  the  rating. 

LEVEL  9 

Chief.  Budget  Div,  Hq  Major  Air  Command 

Staff  Legal  Officer,  Military  Affairs,  Hq  USAF 

Cmef,  Weapon  System  Testing  Div,  Space  &  Missile  Systems  Org 

LEVEL  8 

Deputy  Commander,  Combat  Support  Gp 

Missile  Maintenance  Inspector,  1G,  Hq  Major  Air  Command 

DCS/Comptroller,  Hq  Numbered  Air  Force  (Overseas) 

LEVEL  7 

Logistics  Officer,  Space  &  Missile  Systems  Org 

Experimental  Flight  Test  Officer,  Hq  Aeronautical  Systems  Division 

Chief  of  Personnel,  Combat  Support  Gp 

LEVEL  6 

Commander.  Organizational  Maintenance  Sq 

Missile  Safety  Officer,  Strategic  Missile  Wg 

Missile  Combat  Crew  Commander  (1CBM),  Strategic  Missile  Sq 

LEVEL  5 

Maintenance  Officer,  Strategic  Missile  Wg 
Base  Operations  Officer,  Combat  Support  Gp 
Aircraft  Commander  KC-135,  Air  Refueling  Sq 

LEVEL  4 

Munitions  Maintenance  Supervisor,  Munitions  Maintenance  Sq 
OIC,  Maintenance  Analysis  Branch,  Communications  Area 
Fighter  Interceptor  Pilot,  Fighter  Interceptor  Sq 

LEVEL  3 

Reconnaissance  Pilot,  Tactical  Reconnaissance  Sq 
Pilot,  Transport,  Military  Airlift  Sq 
Special  Services  Officer,  Services  Sq 

LEVEL  2 

Traffic  Management  Officer,  Transportation  Sq 
Fuels  Officer,  Air  Base  Gp 
Helicopter  Pilot,  Combat  Support  Gp 

LEVEL  1 

Recreation  Services  Officer,  Combat  Support  C>p 
Pharmacy  Officer,  USAF  Dispensary 
Photographic  Officer,  Reconnaissance  Technical  W* 


i 


FACTOR  8:  PLANNING:  The  extent  to  which  planning  is  required  by  the  job.  Consider  the  scope 
and  significance  of  work  for  which  planning  is  done.  The  longer  the  time  span  for  which  planning  is 
done,  the  lnghe;  •nc  rating  should  be. 

LEVEL  9 

Depots  Chief,  Plans  Division.  Hq  Major  Air  Command 
Asst  Director  of  War  Plans,  Hq  Major  Air  Command 
Director,  Joint  Operations  Task  Force,  NORAD 

LEVEL  8 

Chief,  R  &  D  Contracts  Div,  Air  Force  Special  Weapons  Center 
Management  engineering  Officer,  Air  Materiel  Area 
Wing  Logistics  Officer,  Air  Refueling  Wg 

LEVEL  7 

Maintenance  Control  Officer,  Bomb  Wg 
Deputy  Commander,  Combat  Support  Gp 
Budget  Officer.  Air  Base  Gp 

LEVEL  6 

Opetalions  Officer,  Fighter  Interceptor  Sq 
Hospital  Administrator,  USAF  Hospital 
Chief,  Data  Services  Division,  Combat  Support  Gp 

LEVEL  5 

Chief.  Career  Control  Brandi,  Air  Base  Gp 
Traffic  Management  Officer,  Transportation  Sq 
Procurement  Officer,  Combat  Support  Gp 

LEVEL  4 

Missile  Combat  Crew  Commander,  Strategic  Missile  Sq 
Wing  Administration  Officer,  Military  Airlift  Wg 
Weapons  Officer,  Tactical  Fighter  Wg 

LEVEL  3 

Fleet ioiiu  Warfare  Officer,  Bomb  Sq 

Medical  Administrative  Officer,  USAF  Dispensary 

Reconnaissance  Pilot,  Tactical  Recoil  Sq 

LEVEL  2 

Fighter  Interceptor  Pilot,  Fighter  Interceptor  Sq 

Registrai ,  Medical  (  enter 

Security  Police  Officer,  Security  Police  Sq 

LEVEL  1 

Flight  Nurse.  Aeronautical  Fvacuation  Sq  (Overseas) 

Weather  Foici  aster .  Weather  Del 
Optometrist .  Medical  Center 

II! 


FACTOR  9:  MANAGEMENT:  The  level  of  executive,  and  managerial  skills  required  in  the  job. 
Consider  the  complexity,  variety,  and  level  of  the  activities  which  are  directed,  organized, 
coordinated,  controlled,  commanded,  or  evaluated. 

LEVEL  9 

Director  of  Budget,  Hq  Major  Air  Command 
Commander,  Combat  Support  Gp  (Overseas) 

Wing  Commander,  Tactical  Control  Wg  (Overseas) 

LEVEL  8 

Wing  Commander,  Aerospace  Rescue  &  Recovery  Wg 
Chief  of  Operations,  Strategic  Missile  Sq 
Deputy  Commander.  Air  Base  Gp 

LEVEL  7 

Maintenance  Supervisor,  Avionics  Maintenance  Sq 
Squadron  Operations  Officer,  Combat  Crew  Training  Sq 
Base  Accounting  &  Finance  Officer,  Flying  Training  Wg 

LEVEL  6 

Chief,  Consolidated  Base  Personnel  Office,  Combat  Support  Gp 

Base  Procurement  Officer,  Pilot  Training  Wg 

Helicopter  Squadron  Operations  Officer,  Flying  TrainwgSq 

LEVEL  5 

Traffic  Management  Officer.  Transportation  Sq 

Base  Communications  Maintenance  Officer,  Communications  Sq  (Overseas) 

Missile  Combat  Crew  Commander,  Strategic  Missile  Sq 

LEVEL  4 

Chief,  Utilities  Operations  Division,  Civil  Engineering  Sq 
Chief,  Photo  Evaluation  Branch,  Photographic  Sq 
Base  Fuels  Officer,  Supply  Sq 

LEVEL  3 

Primary  Pilot  I  raining  Instructor,  Pilot  Training  Sq 
Space  Siuveillancc  Officer.  Aerospace  Support  Sq 
Air  Traffic  Gondolier,  Communication  Sq 

LEVEL  2 

Administrative  Officer,  Air  Base  Sq 
Data  Scrvii  es  Officer,  Combat  Support  Gp 
Tactical  l  ighter  Pilot ,  Tactical  Fighter  Sq 

LEVEL  1 

Gliriic.il  Psychologist,  DSAF  Hospital 
Psychiatric  Social  Worker,  USAF  Hospital 
Helicopter  Pilot  Single  Rotor,  Air  Base  Sq 

PI 


I  OH 

Present  (.radi 


•im.AMY  <:.  pkojkctions  -  comparisons  for  :>t 

l  TII.I/M’ION  FIF.I.IIS  (2-011  \l<\<  TFK  M  M.) 


TITFF  OIRFOTOR  OF  I'FRsoWFI  MWV.FMFNT 
\Fm  oolo 


M*() 


1  01 

Sum  pit- 

«M.N 

Dee  7.7 

June  76 

(.rude 

Size  N 

% 

N 

J5»  !l*-rr 

N  % 

\  % 

Ctll 

21 

1 70 

>o  11 

12' 

U  II 

I : 

1  IJ 

7<i  Vi 

1  14 

71.2.7 

I  t  Col 

i: 

1 1<» 

H*  76 

1  >2 

.11. 

•  w. 

1 1  l 

J1 

|(M 

88  18 

\1aj 

- 

- 

- 

2  1 . 

je. 

*»  J', 

Jo 

‘*2'» 

1  apl/l.l 

- 

- 

- 

- 

- 

- 

- 

8 

i.o: 

I  otal 

u 

286 

JW. 

JH1 

281 

rni  F  ok<;\m/\iion  commwhfr 
m  si  :  0020 


I  OK 

Rrrsenl  llradr 


MaO 


Sample  - _ 

l  01. 

o<;r 

»«•<•  75 

June  <’6 

Crade 

Size 

n  % 

N  % 

Difference 

N  % 

\  % 

Oil 

51 

204 

62.08 

.121 

67.72 

+  27 

2>U 

62.16 

207 

70.61 

1  I  Col 

III 

180* 

87.07 

117 

24.68 

-68 

IW 

81.80 

171 

84.84 

Maj 

- 

- 

- 

Id 

7.70 

+  86 

20 

6.18 

•>7 

8.42 

Capl/I.l 

- 

- 

- 

- 

- 

- 

1 

.21 

8 

1‘ntal 

(4 

171 

IT  1 

171 

m 

TITI.F:  IMRKOTOR  OF  OPERATIONS 
AFSC:  OO.to 


FOR 

Presenl  (.rad«* 


Sample  _ 

nil. 

<H.R 

l><<-  75 

June  76 

<  irade 

Size 

\  ‘V 

\  % 

Difference 

\  % 

\  % 

Col 

102 

6H 

87  88 

.».».» 

7.7.81 

-80 

680 

81.61 

618 

77.70 

1  1  1  ol 

8 

08* 

12.62 

182 

21.60 

+  80 

187 

17.70 

l(v8 

2121 

Ma, 

- 

- 

- 

- 

- 

- 

7 

80 

0 

111 

C.a|il/I  1 

- 

— 

_ 

- 

— 

— 

- 

- 

1 

18 

Total 

no 

787 

787 

788 

701 

*S*t  explanation  attached  in  llii*.  \ppendix  0 .)  regarding  desirable  -ample  -i/e  ehart.  t  Caution  in  the  interpretation  of  re-nlt-  lor 
tbr-e  roll-  i-  advised  due  In  ■'ample  -i/e. 


r»n 


TITLE:  DIRECTOR  OF  LOGISTICS 
AFSC:  0046 


l  OK 

Pri-wnl  Grade 


Mao 

I'DL  OGR  Dec  75  June  76 

Sample  -  - - -  -  - 

Grade  Size  N  %  N  %  Difference  N  %  N  % 


I  All 

37 

261 

72.30 

222 

(>4.51 

-28 

28'. 

71.25 

250 

70.PI 

l.i  Col 

6 

100* 

27.70 

1 28 

:tr>Ui 

+  28 

22.50 

HI 

22.76 

Maj 

- 

— 

— 

— 

— 

— 

21 

6.00 

25 

(>.78 

(lapt/l.i 

- 

- 

- 

- 

- 

- 

1 

.25 

1 

Total 

i.i 

:i6i 

261 

400 

469 

TITLE:  COMPTROLLER 
AFSC:  0056 


l  OH 

IVesrnl  (iradr 


MAC) 

VDL  OGR  Dee  75  June  76 

Sample  -  - - -  -  - - 


Grade 

Size 

N 

% 

N 

% 

Difference 

N 

% 

N 

% 

Gol 

17 

107 

15.75 

70 

29.91 

-87 

81 

36.00 

7- 

2 1.28 

l.t  (  All 

17 

127 

51.27 

161 

70.(8) 

+  37 

87 

88.67 

<4 

11. <16 

Maj 

- 

- 

- 

- 

- 

— 

5.2 

23.56 

51 

>•> 

( iapt/l.t 

— 

— 

— 

- 

— 

— 

1 

1.78 

O 

.86 

Total 

:u 

221 

221 

225 

221 

TITLE:  AIR  COMMANDER* 
AFSC:  0066 


FOR 

Present  Grade 


MAO 

VOX.  (Mis  Dec  75  June  76 

Sample  _  _ -  —  _  _ 


Grade 

Size 

N 

% 

w 

% 

Difference 

IN 

% 

N 

% 

Ca.l 

27 

2(81* 

65.1.2 

161 

88.58 

-15 

1  99 

91.28 

201 

94.37 

1.1  C..I 

3 

1(1* 

1.57 

25 

11.12 

+  1 5 

1 9 

8.72 

12 

5.03 

Maj 

( .apt/1.1 

1  otal 

- 

- 

- 

- 

- 

- 

- 

- 

- 

.30 

216 

216 

2 1 8 

213 

•See  ex  plan  a!  ion  at  incited  lo  litis  Appendix  (<!)  regarding  desirable  sample  sire  rharl.  Gaul  ion  in  I  lie  inlerprelalion  of  results  for 
I  hew-  cells  is  advised  due  to  sample  size. 


TITI.K:  PLANNING  AND  PROGRAMMING  OKK1CKK 
AFSC:  0U7(. 


I 


T1T1.K:  AIK  TRAFFIC  CONTROL  OPERATIONS 
AFSC.  I(i\\ 


COR 

Prewitt  (>radr 


MftO 


Sample  _ 

cm. 

OCR 

l)r.  73 

June  76 

Crude 

Siw 

N  % 

N  % 

Difference 

N  % 

>  % 

Col 

II 

10* 

2.58 

24 

:c«7 

+  8 

It 

2  14 

15 

2.45 

l.t  Col 

:» 

44* 

7.10 

51 

8.23 

4  7 

64 

0.50 

64 

10.04 

Maj 

20 

**H 

15.81 

100 

23.81 

4  62 

118 

17.00 

116 

18  18 

( lapt/l  .t 

<►$ 

K)2 

74.52 

485 

(>2.  lo 

-77 

t02 

70.42 

413 

00  14 

Total 

100 

(i2(l 

620 

65  7 

638 

TITLE:  WEAPONS  IHRECTOR/CONTROLLER 
AFSC:  I7\\ 


COR 

I’rr-riM  ( . raiit- 


M«(l 


Sample  _ 

cm. 

OCR 

lire  73 

June  76 

(.fade 

Size 

N  % 

!S  % 

Difference 

N  \ 

N  % 

(  All 

8 

lo* 

1.12 

•>- 

l.»0 

+  11 

13 

1.02 

13 

1  08 

l.t  Col 

I'l 

12(1 

818 

12.3 

8.73 

+  5 

lid 

7. *81 

110 

8  34 

Maj 

32 

234 

17  71 

347 

24.2.3 

+  04 

281 

I'l.  1.3 

2(>2 

18.81 

Capt/l.t 

i:h 

1 .042 

72.77 

(>.3.1.3 

-100 

1.037 

71.03 

<817 

71.37 

Total 

2i:i 

1 . 1.12 

1.132 

1 .400 

1.30.3 

TITLE:  MISSILE  OPER  ATIONS 
AFSC:  I8XX 


COR 

I'reM-nt  CraHr 


Sample  _ 

Mao 

cm. 

OCR 

Dec  75 

June  76 

Crade 

Size 

>  % 

N  % 

Differenee 

N  ‘S» 

\  % 

Col 

16  42  80 

52 

l  45 

♦  2o 

20  71 

28 

:t 

I  f  Col 

t:  200  584 

1 72 

t  80 

-37 

lit  2  H‘» 

112 

2  ot 

Maj 

150  6.4 1  17  68 

70| 

22.18* 

4  157 

372  0.14 

481 

1000 

1 .apt /I  .1 
Total 

512  2.710  75  50 

725  4.585 

2.570 

3.585 

71.60 

1  to 

4.128  86  01 

4.0|4 

3.280 

4.801 

H6  2  4 

♦Sec 

explanation  attached  to  thi*  \ppendix  (C) 

regarding  desirable  •‘ample 

«.i/e  chart 

<  aiitimi  m  the  mterpretai 

Mill  of  re 

■oilt*  for 

tlm-r  4  •■II-  i-  d<lti-rll  ilm*  In  -.tin pit  -i/r 


TITLE:  SPACE  SYSTEMS 
AFSC:  20XX 


tor 

Present  Grade 


Sample  _ 

MaO 

11)1 

<m;r 

Dec  75 

June  76 

Grade 

Size 

N  % 

N  % 

Difference 

N  % 

N  % 

Col 

7 

15* 

H.5(> 

15 

2.01 

-2 

16 

5.41 

l(> 

:i.72 

1.1  Col 

l(i 

50 

11.10 

47 

10.51 

-5 

.'15 

7.  K> 

Ml 

V.30 

Maj 

25 

l(M) 

22.57 

77 

17.25 

-25 

00 

10.10 

85 

1*>.7T 

( apt/1.1 

51 

282 

05.00 

510 

00.55 

+  28 

:i28 

00.04 

280 

67.21 

Total 

t)7 

■147 

447 

160 

150 

TITLE. 

SPECIAL  OPERATIONS* 
AFSC:  2 1 XX 

tor 

Present  (irade 

M*o 

1 1)1. 

OCR 

Dec 

75 

June 

76 

Grade 

Size 

N 

% 

N  \  lliffrrrnrr 

% 

% 

N 

% 

( ail 

i 

2* 

6  67 

-  .-> 

i 

2  78 

i 

18.'. 

1.1  <4)1 

5 

6* 

:io.oo 

o  ;io.oo  _ 

8 

■>•»  •>•) 

8 

:io  77 

Ma, 

2 

12* 

tfMNI 

10  (.4  55  .7 

1 1 

1HH0 

0 

:i  i  62 

<  apt /It 

i 

7* 

25.55 

2  6.67  :> 

15 

50.11 

H 

:io 

Total 

7 

.10 

10 

:io 

26 

TITLE:  AIK  OPERATIONS  OFFCKR.  NWICATOR  OBSERVER 


AFSC:  22XX 

KIR 

Present  Grade 

mao 

(Til. 

(K.R 

IW  75 

June 

76 

Grade 

Size 

N 

% 

N  %  Difference 

N  % 

N 

% 

i..i 

0 

1  55 

11  1.01  .2 

11  1  12 

12 

i  n 

I  t  loi 

no 

172 

18  58 

512  2111  ♦ 70 

o.'*o  :i2  *n 

w:i 

II  !/• 

Maj 

|‘8) 

80.1 

55. 1  l 

I..J86  51.55  4  PM 

1.152  10  1.5 

1.117 

16.71 

1  a|>l/lt 

180 

1.157 

14.75 

572  22.51  -  505 

K.l  1.08 

510 

17.70 

Total 

501 

2.511 

2.541 

2.881 

2.882 

•See  i 

'KplanaOoii  aftarhed  in  ibis  \ppcndix  U  .) 

regarding  desirable  sample  size  chart 

taut  mil  in  the  interpretation  of  results  for 

these  cells 

I*  advised  due  to 

sample  size. 

these 


TITLE:  COMMUNICATIONS  -  KLECTKONICS 

afsc:  :ioxx 


1  OH 

Present  Crade 


MaO 

I'DL 

tM.lt 

l)t*r  75 

June  76 

Crade 

Size 

N  % 

IN  % 

Difference 

N  % 

N  % 

C-ol 

25 

i:t 

5.33 

I5(i 

1.78 

IK 

145 

4.74 

i;u 

4.01 

I  t  Cot 

t>; 

161 

1  Ml 

I7(i 

1 1.5'* 

+  r> 

40,4 

H.U 

;mr> 

K.KO 

Maj 

I'M 

836 

25.63 

1.18)3 

55.51 

-f  257 

H20 

22.66 

856 

24.06 

Capt/l.t 

2'M 

l.7<)| 

51. <81 

1.5.17 

17.12 

+  25  l 

2.550 

65.  IK 

2.145 

62.2  1 

Total 

578 

.1.2(12 

8.262 

.Uiv 

4.  140 

TITLE:  MISSILE  MAINTENANCE 
AFSC:  :nxx 


l OR 

I’rfjifnl  (Irwlc  f 


MaO 


Sample  _ 

nil. 

OCR 

Dec  75 

June  76 

(»rad«- 

Size 

•N  % 

N  % 

Difference 

N  % 

N  % 

(  all 

18 

25 

l.«>l 

21 

1.1.4 

-4 

26 

1.74 

22 

1.40 

l.t  Col 

18 

7') 

15.52 

81 

15.01 

+  2 

58 

0.67 

56 

10.0| 

Maj 

28 

ll'l 

2.8.88 

115 

22.5*) 

-4 

111) 

20.07 

105 

20.51 

C.apt/1,1 

7(1 

28(i 

56.11 

212 

57.57 

+  6 

851 

65.51 

320 

64.26 

Total 

ll<> 

5(8) 

518) 

518 

512 

TITLE:  AIRCRAFT  MAINTENANCE/*  V IONICS 
AFSC:  40XX 


FOR 

I'n’M’iH  (iruHr 


Mao 


Sample 

Size 

i  m 

(h;h 

!)«■«• 

75 

Crade 

> 

% 

n 

% 

Difference 

N 

% 

i.ii 

13 

201 

681 

l‘)l 

6.50 

in 

l‘H» 

(1.03 

U  sc 

1 1 1  ..1 

1  16 

60| 

20  1  1 

6.4 1 

21.*>2 

t  55 

54.4 

16.17 

collapsed 

Maj 

154 

78.4 

26.21 

027 

.41.07 

•  III 

672 

211.61 

cointuneil 

( a|il/l.l 

T.ilal 

26.4 

605 

1 .4'X» 

2.081 

16.78 

1 .20*) 

2.0K1 

10.42 

■  187 

1.815 
4.2  IK 

56.80 

witli  0»\\ 

*See  explanation  attached  to  thi«  \pf»endix  (< 4  regarding  desirable  sample  >i/r  chart.  <  laulion  in  I  In-  interpretation  of  results  for 
these  rrll*  is  advised  due  to  sain  file  him*. 


r 


TITLE:  AEROSPACE  MUNITIONS 
AFSC:  46XX 


< rade 

Sam  pit* 

Si*t* 

MSO 
l  1)1. 

ocr 

DiffcrciKT 

Oft* 

in 

Prese  ni 

77. 

R 

Crade 

— 

!\ 

% 

N 

% 

N 

•v 

Col 

6 

1 1* 

1.72 

20 

2.  ki 

+  0 

i.i 

1.58 

\KS( 

1.1  Col 

21 

12:1 

1 5. 11 

i:u 

10.11 

+  8 

04 

II  .45 

• ollapsed 

Maj 

35 

1<)2 

23.62 

33.  n> 

+  80 

1.18 

10.81 

e<uiihim*d 

('.apt/l.t 

60 

Kit 

vt.r>:i 

300 

17.07 

-«4 

r>7(» 

To.  16 

wilh  0>\\ 

Total 

in 

8 1.1 

hi:i 

821 

TITLE.  COMPl  TER  SYSTEMS  TECHNOLOOV 

AFSC:  51XX 

f.rade 

Sample 

Size 

Mot) 

11)1. 

OCR 

Differenee 

1).M- 

l  OR 

Present  4»rade 

73  June  76 

N 

% 

N 

% 

N 

% 

>  % 

(  All 

0 

71* 

1.11 

12 

1.40 

-10 

18 

54  2.52 

1,1  4’aiI 

12 

280 

10.71 

101 

lilt 

A  7.1 

02 

8  00 

200  0  73 

Maj 

<81 

401 

22.01 

Ott 

:io.o:> 

+  151 

M)| 

i«:»8 

120  10  08 

Capt/I.l 

211 

1.151 

0.1.04 

1.104 

54.12 

-187 

1.517 

70.30 

1.155  07  77 

Total 

.142 

2.1  n 

2.1  11 

2.158 

2.1 17 

TITLE:  CIVIL  ENGINEERIN'!', 

AFSC:  55  XX 

Oracle 

Sample 

Si*e 

Mat) 

1 1)1. 

(M.R 

Difference 

1)..  1 

l  OR 

Present  (,rade 

’7»  June 

76 

n  % 

N 

% 

N 

\  N 

X 

(  All 

28 

118  711 

152 

7  81 

•  1 1 

101 

‘1  12  loi 

3  26 

l  .1  4  All 

.V# 

28.1  1 1.57 

218 

12  20 

r. 

2<>6 

11  50  271 

1 1 21 

Maj 

60 

181  1077 

iH 

28.01 

4  1641 

181 

10  .33  C,f 

18  M 

Capl/I.l 

188 

1.117  5855 

1.008 

51  01 

120 

1 .22:1 

62.413  1.10  { 

62  10 

Total 

1H 

1 .012 

1.012 

-- 

1.071 

1.021 

•See  1 

’xplanatitui  attached  in  ihi*.  \ppendi%  6 

1  rrjjanlirn:  deMralde  sample  *.i/e  chart  1  .antmn  in  ll 

ie  inierprelaiioii  of  re 

•«  for 

the*te  rell* 

i**  adt  i*»ed  dm*  to 

xampfc  -»i/e 

. . 

_ _ 

TITI.K:  CARTOGRAPHY 
AFSC:  :»7\\ 


I 


TITI.K:  KI>1  CATION  AM)  TKAIMV 
AFSC:  7f>\\ 


I  OR 

Present  (>rad«‘ 


MaO 

l  in. 

Ot.K 

Dec  T.» 

June  70 

( .rade 

Siw* 

\  % 

N  % 

Difference 

N  % 

N  X 

(ail 

i;> 

HO 

i2.:>o 

00 

10.78 

-11 

08 

lo.ll 

0(i 

08 1 

1.1  Col 

ih 

1KI 

28.28 

loo 

21.0 1 

-11 

170 

20.08 

180 

28  17 

Maj 

11 

101 

10.11 

210 

17.11 

+  n 

21 1 

1 1  H 

loo 

20.21 

( lapt/l.t 

12 

ih:» 

28.01 

loo 

21.0  \ 

-10 

211 

11.71 

22o 

12  70 

Total 

120 

010 

010 

071 

071 

TITI.K:  INFORMATION 
A I  SC:  TOW 


I  OH 

I'rvsrn I  l.railr 


Sample  _ 

Mao 
i  J)i. 

<m;r 

Dee  71 

June  70 

l.rade 

Size 

N  % 

\  X 

Difference 

N  % 

\  % 

Call 

0 

17* 

8.1o 

2(> 

l.ol 

■ji 

:u 

1.7o 

:vi 

.vr.i 

l.l  (  ail 

11 

107 

10.01 

121 

21.80 

a  III 

77i 

12.71 

77 

i.i.j'i 

Maj 

21 

I7H 

11.07 

180 

11.01 

a  1  1 

1 1:> 

21.18 

1  IT 

j'l.iu 

( a)|il/l.l 

12 

_>:t(i 

10.01 

22 1 

10  80 

■(1 

:i;i(i 

lo.ol 

H2.T 

7).V'I| 

Total 

80 

7i(iJ 

.102 

:><m 

">KI 

T1TI.K:  INTKI.l.ICKNCK 
A  ISC:  HOW 


I  OH 

IV**M*nl  l.raHr 


MaO 

1 1*1 

OI.H 

Dei*  71 

June  70 

rade 

Size 

>1  X 

N  % 

Difference 

\  X 

N  ‘V 

1  el 

21 

1 11 

0.11 

111  110 

-22  110  1.11 

118 

1  ol 

It  r„! 

10 

110 

1 1.21 

!M»  11.18 

4  27  200  n,81 

200 

1 1 .82 

Maj 

80 

11  1 

21 1)0 

788  11.11 

)27l  111  21.08 

lo  | 

22  87 

1  i.tpl/l  .1 

107 

1.172 

17.0.1 

1.001  H.02 

-270  1.11 1  ol  0! 

l.lol 

10  08 

Tula! 

111 

2.180 

2.180 

2. *2* 

2  Ml 

VSr 

rxpl.mallnn  .llf.H  Itei 

1  In  llll- 

\ppeniliv  0 

1  rey.irilmji  ilc-ir.dilr  -.impl* 

•  -i/e  t  h.irl  <  .uilini)  in  fl*e  iuletpr<  1 

1.(0(111  nf  re- 

-llll-  till 

ihf'i'  i  ill-  I'  ,t(l\  I'l-il  ilur  In  ".t  1 1 1 1 1 1 1  ■  'i/i- 


l»i 


TITI.K:  SKCIKITY  POINT. 

\rsc:  8i \\ 


I  OK 

Pmfiil  (trade 


M*0 


Sample  _ 

mi. 

<h;r 

Dee  75 

June  76 

(trade 

Size 

IS 

% 

\  % 

Difference 

N  % 

N  % 

<  ail 

it 

82 

■r. 

2.68 

.7 

■>7 

2.76 

28 

2.80 

l.l  Col 

>7 

180 

I.I.liT 

ir>(» 

16.10 

+  26 

75 

7.67 

78 

8.00 

Maj 

28 

176 

iH,r.i 

1*15 

20.50 

4  10 

160 

17.28 

177 

18.20 

Capt/l.t 

80 

618 

(it.  Ui 

575 

60.16 

-88 

707 

72.20 

685 

70.76 

Total 

i:»r> 

or>i 

or,  i 

078 

<>68 

TITLK:  BAND 
AKSC:  87W 


I 'OR 

IVm'IiI  Crailt- 


!M(tO 


Sample  _ 

cm. 

OCR 

!>«■<•  75 

June  76 

(trade 

Size 

N  'V. 

IN  X 

Difference 

N  X 

\  X 

Col 

— 

- 

— 

1 

2.01 

4  1 

1 

2.01 

l 

8.18 

l.l  Col 

1 

1* 

1 1.76 

1 

_>.<>  1 

-8 

8 

8.82 

8 

0.88 

Maj 

5 

0* 

20.17 

i«i 

55.88 

+  10 

8 

28.58 

8 

25.00 

( !a|il/l.l 

18 

•>  1 

61.76 

i.t 

.18.2 1 

-8 

61.71 

20 

02  50 

Total 

■>•> 

;u 

u 

81 

82 

TITI.K:  jnn;K  ADYOCATK 
AKSC.  88\\ 


I  OK 

Pn  srill  (irmfr 


Mao 


(trade 

Sample 

Size 

1  m 

(M.K 

Difference 

Dee  75  June 

76 

\ 

'S, 

N 

% 

N  %  \ 

\ 

i.oi 

18 

1  16 

10.02 

12: 

10  0; 

*  1  1 

88  7  0.8  85 

7  56 

1  1  Col 

51 

218 

20  08 

880 

28  5o 

<  87 

150  11,08  155 

18  25 

Maj 

51 

»“•» 

28  10 

168 

10  tl 

♦  PM, 

187  1001  Ml 

12  21 

(  ..i|il/l  ( 

lol 

527 

15  51 

288 

20.12 

-201 

877  7005  77o 

67  10 

Total 

221 

l .  1 58 

1 . 1 58 

1.252  1.155 

»S,-i 

‘  explanation  aU.uh, 

d  In  tlii- 

\|i|M'lidi\  (1  . 

)  re^iirduif:  di 

•viral.lr 

sample  •»!/«■  *  li.irl  1 

1  utiinm  in  (lit-  otletprel.il  ton  i*l  re' 

‘tills  lot 

llie-e  cells  i-  illlvi-nl  (lili*  Jo  v,mi|i|r  -t/c 

<1.5 


•  \*z'rr  >  Ur* 


TITLE:  CHAPLAIN 
AFSC:  8*)X\ 


l  OK 

Present  (tirade 


MAO 

1 1)1. 

«m;r 

l)«r  73 

June  76 

Orade 

Size 

N  % 

N  % 

Difference 

N  % 

N  % 

(!ul 

21 

86 

10.01 

11 

1.77 

-15 

120 

1  l.t  >8 

126 

11.82 

l.t  (.ol 

2') 

n:> 

1.3.30 

101 

11.76 

-1 1 

234 

26.62 

228 

26.82 

Maj 

30 

ir»8 

l  «.:$<) 

207 

:it.58 

+  130 

253 

28.78 

2.18 

28. (HI 

(aipt/1,1 

85 

rm 

r.H.2 1 

120 

18.80 

-HO 

2(>3 

20.02 

258 

:io.:ir> 

Total 

174 

a  so 

850 

870 

850 

TITLE:  HEALTH  SERVICES  ADMINISTRATOR 
AFSC:  <H)XX 


I  OR 

IVrspllt  lirHcir 


M*0 


Sample  _ 

rin. 

<k;r 

■>«-<■  75 

June  76 

i.rade 

Size 

>  % 

N  % 

Difference 

N  5, 

\  % 

0.1 

18 

70 

7  7*> 

35 

3. 12 

-11 

u 

4.37 

45 

1.12 

l.t  <  .<  )l 

.18 

207 

20.2.1 

210 

20.53 

+:i 

MM) 

10.52 

101 

10.2.1 

Maj 

.10 

205 

20.01 

21  4 

20.02 

+  0 

185 

18.35 

100 

1 8  f»8 

(!apt/Lf 

88 

5.12 

52.00 

:m 

55.13 

+  .12 

67.1 

Mi.  77 

07H 

66.67 

Total 

171 

1.02.1 

1.023 

1.008 

1.017 

TITLE:  BIOMEDICAL  SCIENCES 
AFSC:  <)l\\ 


I  OK 

IVcsrnl  (»rade 


Mao 


Sample  _ 

i  in 

(MR 

1  )«*€*  75 

June  76 

lirade 

Size 

\ 

% 

N  ‘S. 

Difference 

N  % 

V  \ 

(ill 

0 

11* 

1.01 

1  1 

1  61 

-2 

17 

2  11 

10 

2.68 

l.i  <:»i 

10 

5++ 

7.02 

70 

10.26 

4  18 

78 

lo.7<» 

h:i 

1171 

Maj 

22 

115 

low. 

1  Ki 

21.11 

4.11 

loo 

1.1  70 

07 

1.168 

f apt/l  l 

88 

502 

73.01 

455 

66.72 

17 

5.10 

::i  io 

5lo 

7l.o;< 

Total 

120 

682 

'.82 

.  2> 

7oo 

•S'i  explanation  attached  to  (his  \ppettdix  (<i)  regarding  desirable  simple  *i/e  chart.  <  aiitinn  in  die  interpretation  oi  result-  for 
these  cells  is  advised  due  to  sample  size. 


<><> 


TlTLK:  IMF.TU'.I  AN.  OCCll* ATIONAI.  THKR APIS T.  PHYSICAL  T1IKRAPIST 
PHABMACIST.  OPTOMKTRIST.  BIOMKD1CAL  SPKCIAUST 
AFSC:  ‘I2XX 


I  rcM*nt  (.radr 


IKt  75 

N  % 


Junr  7 1\ 
N 


TlTLK:  Nl  RSK 
AFSC:  ‘>7\\ 


rrr’seiil  tirade 


nilfcrriiri 


IW  75 

N  % 


J  uirt*  70 

N 


TlTLK :  YKTKRINARY 
AFSC:  «W\\ 


Sample 

mi. 

(Mil 

Difference 

lire 

Present  (.r«d«- 

7.y  June 

7(i 

Si  *«• 

N  '\. 

N 

\ 

N 

% 

\ 

% 

*t 

*\*  :«>:» 

1  1 

1.0 1 

-10 

2.1 

:  :»t 

2(i 

h  7n 

1  1 

U>  1.12."* 

(»(• 

->l  It  ' 

♦  2(1 

<»:i 

2o.w» 

VI 

1  *121.1 

11 

KV*  27  HI 

71 

_M  IT 

-1 1 

1 H  o.l 

■|.l 

17.01 

IT*  1 

1  t‘> 

K.l 

:»;i :: 

l.iK 

:>:i  :m 

.102 

Mr* 

{(»', 

2‘Wi 

e  explanation  attach* 

<1  In  llii1'  \ppemlix  (<  1 

n^ariim^  <le»iral*lc  sample  >i /»■  chart 

million  in 

the  interpret  jlmn  of  result*  for 

!U  aihN'd  due  to  sample  -i/e. 

- 

aKdsj&i  v*' 

DESIRABLE  SAMPLE  SIZEXH  ART 


Sam |>|«-  Si/.«* 


Wrj  Small 

Small 

Mt'dium 

A 

H 

\ 

i< 

IF 

MM)  EDI, 

Copulation  (N) 

IS 

N  = 

1  —  10 

\  - 

11-25 

N  - 

20—  AH 

\  ~ 

.50-. VI 

\ 
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Overall,  the  sample  percent  of  the  entire  study  across  all  grades  and  utilization  fields  was  I  7  .HK  percent, 
based  on  a  1 1. 192  job  sample  of  the  02.002  non-aircrew  M&O  I  1)1,  population.  The  more  fractionated  tin- 
tables  become,  the  less  likely  will  it  be  that  particular  sample  will  represent  17  percent  of  the  population. 
Eor  large  samples  such  as  utilization  field  51\X.  Computer  Systems  Technology,  a  sample  of  21 1  Captains 
and  Lieutenants  should  he  representative  even  if  21 1  jobs  do  not  constitute  IT  percent  of  the  I 55 I  Mill 
EDI,  jobs.  On  the  other  hand,  for  utilization  field  21XX.  Special  Operations,  the  grade  of  Colonel,  a 
sample  of  one  constitutes  50  percent  of  the  two  jobs  in  the  EDI.,  but  would  not  he  as  good  for  a  projection 
base  as  if  both  EDI.  M&O  jobs  had  been  used. 

If  a  sample  is  less  than  that  indicated  hv  the  desirable  sample  size  chart,  an  asterisk  (*)  appears  after  that 
grade  by  utilization  field  cell.  If  most  cells  within  a  utilization  field  have  been  identified  as  weak  lor 
porjection.  the  entire  table  has  been  so  marked  in  the  title  of  that  utilization  field. 

Eor  example:  the  utilization  field  0000.  Air  Commander,  has  10  M<XO  EDI.  I.t  Colonels  listed  —  then  the 
desired  sample  size  would  he  10.  one  sample  for  every  population  job.  The  sample  contains  only  three  I  t 
Colonel  jobs,  rather  than  10.  and  the  listing  is  subsequently  marked  with  an  (*)  asterisk. 
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1 6  JAN  1981 


to:  Defense  Technical  Information  Center 
Attn:  DTIC/DDA  (Mrs  Crumbacker) 
Cameron  Station 
Alexandria  VA  22314 


1.  Please  remove  the  Export  Control  Statement  which  erroneously  appears  on 

the  Notice  Page  of  the  reports  listed  .  This  statement  is 

intended  for  application  to  Statement  B  reports  only. 

2.  Please  direct  any  auestions  to  AFHRL/TSR,  AUTOVON  240-3877. 

FOR  THE  COMMANDER 

WENDELL  L.  ANDERSON,  Lt  Col,  USAF 
Chief,  Technical  Services  Division 
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